-- Logs begin at Fri 2021-04-16 16:10:36 UTC, end at Fri 2021-04-16 17:06:44 UTC. -- Apr 16 16:40:41.429934 dv-cinder-733622-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 16 16:40:41.437537 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: *** Starting uWSGI 2.0.15-debian (64bit) on [Fri Apr 16 16:40:41 2021] *** Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: nodename: dv-cinder-733622-13-iscsi Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: machine: x86_64 Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: clock source: unix Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: pcre jit disabled Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: detected number of CPU cores: 4 Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: current working directory: / Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: detected binary path: /usr/bin/uwsgi-core Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: dropping root privileges as early as possible Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: your processes number limit is 47843 Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: your memory page size is 4096 bytes Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: detected max file descriptor number: 2048 Apr 16 16:40:41.439790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: lock engine: pthread robust mutexes Apr 16 16:40:41.441213 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: thunder lock: enabled Apr 16 16:40:41.441213 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 16 16:40:41.441213 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: dropping root privileges after socket binding Apr 16 16:40:41.441213 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 16 16:40:41.485908 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: Python main interpreter initialized at 0x55aee67bb9c0 Apr 16 16:40:41.485908 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: dropping root privileges after plugin initialization Apr 16 16:40:41.485908 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: python threads support enabled Apr 16 16:40:41.485908 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: your server socket listen backlog is limited to 100 connections Apr 16 16:40:41.485908 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: your mercy for graceful operations on workers is 90 seconds Apr 16 16:40:41.486434 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: mapped 402621 bytes (393 KB) for 2 cores Apr 16 16:40:41.486434 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: *** Operational MODE: preforking *** Apr 16 16:40:41.486608 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: dropping root privileges after application loading Apr 16 16:40:41.486608 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: *** uWSGI is running in multiple interpreter mode *** Apr 16 16:40:41.486608 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: spawned uWSGI master process (pid: 84615) Apr 16 16:40:41.488521 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: spawned uWSGI worker 1 (pid: 84616, cores: 1) Apr 16 16:40:41.488521 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: spawned uWSGI worker 2 (pid: 84617, cores: 1) Apr 16 16:40:41.488521 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 16 16:40:41.486774 dv-cinder-733622-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 16 16:40:46.501323 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 16 16:40:46.501856 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 16 16:40:46.503312 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 16 16:40:46.503742 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 16 16:40:46.504033 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 16 16:40:46.504488 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.504855 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.505214 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.505570 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.505682 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 16 16:40:46.505911 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 16 16:40:46.506015 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.506266 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.506648 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.507006 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.507377 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.507481 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 16 16:40:46.507672 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.507900 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 16 16:40:46.508010 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.508194 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 16 16:40:46.508368 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733622-13-iscsi {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.508655 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.508769 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.509021 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.509124 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.509370 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.509483 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.509723 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.509825 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.510055 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.510157 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.510441 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.510560 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.510784 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.510886 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.511126 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.511405 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.511558 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.511756 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.511874 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.512097 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.512212 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.512443 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.512552 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733622-13-iscsi {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.512805 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.512912 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.513149 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.513252 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.513490 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.513591 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.513846 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.513939 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.514182 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.514305 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.514568 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.514662 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.514906 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.515009 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.515270 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733622-13-iscsi {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.515500 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.515628 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.515844 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.515958 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.516185 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.516298 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.516533 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.516710 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.516915 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.517059 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.517268 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.517377 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.517621 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.517727 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.517985 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.518131 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.518721 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.518890 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.518995 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.519091 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.519185 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.519286 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.519496 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733622-13-iscsi {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.519608 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.519849 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.519964 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.520198 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.520300 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.520547 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.520647 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.520889 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.521057 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.521259 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.521355 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.521602 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.521705 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.521943 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.522038 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.522227 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.522414 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.522601 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.522704 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.522965 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.523059 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.523330 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.523424 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.523698 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.523802 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.523984 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.524078 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.524269 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.524369 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.524630 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.524724 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.524998 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.525098 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.525351 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.525468 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.525693 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.525797 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.526031 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.526144 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.526330 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.526429 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.526685 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.526779 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.527035 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.527144 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.527379 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.527479 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.527720 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.527821 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.528012 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.528112 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.528298 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.528398 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.528667 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.528776 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.529088 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.529185 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.529344 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.529439 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.529697 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.529802 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.103 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.530037 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.530139 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.103 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.530403 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.530512 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.530752 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.530859 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.531097 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.531190 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.531442 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.531536 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.531787 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.531890 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.532141 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.532240 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.532486 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.532588 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.532827 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.532930 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.533166 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.533318 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.533519 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.534206 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.534444 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.534600 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.103 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.534995 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.535139 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.103 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.535279 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.535433 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.535646 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.535859 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.536001 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.536147 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.536286 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.536486 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.536641 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.536840 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.536994 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.537184 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.537329 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.537519 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.537673 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.537859 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.538006 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.538191 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.538359 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.538560 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.538718 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.538901 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.539062 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.539293 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.539438 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.539577 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.539724 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.539864 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.540004 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.540142 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.540283 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.540429 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.540577 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.540772 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.540925 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.541118 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.541273 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.541463 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.541610 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.541800 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.541953 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.542133 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.542326 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.542489 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.542631 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.542813 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.542961 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.543154 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.543313 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.543473 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.543614 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.543802 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.543949 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.544140 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.544287 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.544476 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.544623 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.544817 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.544964 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.545153 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.545371 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.545519 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.545674 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.545886 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.546038 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.546178 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.546354 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.546500 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.546641 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.546787 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.546927 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.547119 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.547280 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.547429 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.547570 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.547767 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.547920 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.548102 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.548257 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.548406 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.548545 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.548746 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.548893 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.549081 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.549339 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.550138 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.550321 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.550478 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.550625 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.550773 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.550920 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.551060 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.551199 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.551338 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.551476 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.551623 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.551824 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.551971 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.552169 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.552330 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.552481 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.552632 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.552829 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.552982 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.553168 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.553320 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.553509 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.553668 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.553822 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.553968 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.554163 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.554352 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.554523 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.554668 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.554863 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.555017 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.555225 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.555377 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.555590 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.555742 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.555902 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.556120 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.556271 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.556414 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.556578 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.556723 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.556873 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.557019 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:40:46.557226 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.557380 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.557597 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.557749 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.557940 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.558100 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.558353 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.558521 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.558674 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.558827 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.558973 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.559118 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.559314 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.559477 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.559681 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.559839 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.560039 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.560274 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.560424 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.560583 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.560729 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.560951 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.561117 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.561273 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.561445 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.561636 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.561790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.561936 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.562081 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.562233 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.562425 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.562583 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.562729 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.562873 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.563067 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.563229 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.563418 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.563570 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.563761 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.563920 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.564082 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.564229 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.564419 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.564572 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.564797 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.564990 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.565145 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.565300 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.565570 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.565718 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.565863 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.566006 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.566245 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.566448 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.566597 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.566753 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.566899 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.567044 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.567189 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.567332 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.567487 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.567640 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.567791 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.567936 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.568080 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.568266 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.568419 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.568625 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.568778 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.568978 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.569132 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.569328 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.569481 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.569644 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.569791 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.569987 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.570140 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.570387 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.570550 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.570705 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.570851 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.571034 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.571187 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.571339 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.571492 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.571692 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.571855 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.572041 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.572205 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.572352 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.572504 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.572687 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.572848 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.573036 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.573188 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.573385 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.573545 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.573733 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.573896 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.574078 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.574230 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.574432 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.574593 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.574739 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.574883 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.575097 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.575250 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.575448 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.575601 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.575794 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.575947 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.576107 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.576268 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.576495 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.576647 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.576792 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.576937 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.577123 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.577277 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.577431 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.577576 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.577780 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.577933 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.578079 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.578241 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.578426 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.578574 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.578725 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.578871 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.579074 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.579240 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.579394 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.579539 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.579690 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.579834 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.580033 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.580197 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.580356 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.580554 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.580741 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.580919 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.581064 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.581222 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.581375 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.581520 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.581665 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.581853 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.582006 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.582210 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.582446 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.582603 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.582750 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.582895 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.583039 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.583193 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.583341 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.583535 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.583688 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.583880 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.584045 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.584198 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.584344 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.584544 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.584706 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.584861 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.585020 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.585203 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.585365 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.585518 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.585670 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.585859 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.586019 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.586223 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.586430 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.586663 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.586814 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.586968 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.587121 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.587267 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.587419 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.587564 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.587708 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.587903 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.588065 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.588212 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.588363 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.588569 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.588728 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.588950 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.589098 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.589242 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.589387 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.589538 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.589682 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.589887 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.590048 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.590194 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.590380 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.590539 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.590686 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.590890 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.591053 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.591241 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.591400 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.591547 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.591693 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.591904 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.592056 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.592239 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.592387 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.592531 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.592678 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.592881 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.593033 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.593187 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.593332 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.593530 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.593697 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.593845 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.593989 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.594210 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.594441 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.594588 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.594743 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.594890 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.595041 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.595233 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.595396 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.595542 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.595693 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.595881 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.596034 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.596807 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.596969 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.597115 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.597271 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.597417 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.597562 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.597706 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.597850 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.598015 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.598168 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.598360 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.598519 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.598714 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.598867 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.599026 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.599172 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.599374 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.599526 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.599725 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.599878 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.600090 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.600250 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.600441 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.600593 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.600797 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.600949 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.601141 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.601299 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.601445 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.601588 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.601793 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.601951 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.602145 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.602350 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.602512 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.602657 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.602810 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.602963 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.603162 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.603321 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.603467 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.603612 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.603849 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.604009 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.604194 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.604353 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.604514 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.604658 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.604850 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.605010 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.605193 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.605346 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.605534 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.605687 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.605883 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.606050 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.606197 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.606571 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.606727 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.606966 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.607118 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.607270 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.607417 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.607562 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.607712 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.607919 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.608076 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.608223 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.608369 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.608558 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.608711 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.608909 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.609077 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.609224 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.609369 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.609561 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.609714 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.609906 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.610066 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.610249 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.610438 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.610585 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.610738 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.610932 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.611093 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.611248 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.611393 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.611582 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.612505 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.612726 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.612934 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.613103 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.613250 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.613401 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.613553 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.613707 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.613858 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.614010 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.614215 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.614418 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.614620 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.614783 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.614993 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.615152 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.615336 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.615489 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.615675 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.615839 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.616026 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.616179 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.616335 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.616480 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.616677 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.616831 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.616992 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.617217 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.617370 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.617514 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.617667 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.617814 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.617959 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.618102 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.618324 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.618488 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.618646 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.618791 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.618981 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.619134 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.619324 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.619477 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.619670 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.619824 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.620024 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.620177 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.620372 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.620524 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.620686 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.620832 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.621028 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.621180 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.621375 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.621592 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.621741 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.621885 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.622031 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.622176 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.622397 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.622560 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.622708 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.622870 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.623016 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.623168 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.623313 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.623527 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.623719 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.623878 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.624089 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.624242 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.624476 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.624637 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.624784 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.624929 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.625131 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.625285 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.625444 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.625590 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.625788 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.625941 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.626101 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.626251 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.626454 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.626602 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.626799 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.626958 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.627113 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.627351 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.627585 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.627781 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.627963 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.628140 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.628287 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.628440 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.628594 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.628758 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.628960 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.629111 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.629261 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.629419 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.629572 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.629718 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.629869 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.630013 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.630157 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.630337 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.630489 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.630634 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.630778 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.630923 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.631066 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.631218 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.631373 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.631524 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.631670 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.631819 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.631970 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.632123 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.632274 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.632419 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.632564 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.632709 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.632906 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.633072 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.633218 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.633371 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.633563 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.633723 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.633875 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.634028 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.634181 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.634407 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.634599 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.634752 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.634908 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.635055 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.635264 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.635416 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.635609 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.635762 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.635952 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.636105 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.636301 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.636461 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.636608 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.636753 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.636948 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.637101 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.637291 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.637526 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.637687 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.637843 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.637996 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.638142 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.638353 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.638506 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.638651 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.638797 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.638952 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.639098 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.639249 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.639400 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.639545 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.639697 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.639901 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.640064 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.640264 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.640423 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.640630 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.640790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.640944 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.641095 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.641290 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.641442 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.641638 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.641802 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.641950 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.642104 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.642311 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.642467 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.642682 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.642849 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.643030 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.643191 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.643381 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.643538 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.643713 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.643871 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.644019 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.644164 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.644317 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.644463 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.644619 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.644770 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.644921 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.645067 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.645271 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.645423 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.645614 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.645768 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.645980 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.646134 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.646326 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.646479 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.646636 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.646783 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.646980 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.647134 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.647322 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.647480 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.647727 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.647885 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.648045 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.648191 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.648337 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.648500 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.648647 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.648792 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.648937 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.649081 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.649283 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.649445 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.649635 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.649802 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.649986 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.650140 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.650365 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.650529 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.650684 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.650830 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.650974 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.651119 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.651343 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.651505 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.651694 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.651847 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.652026 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.652174 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.652416 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.652568 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.652713 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.652867 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.653012 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.653157 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.653309 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.653456 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.653695 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.653848 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.654039 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.654192 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.654388 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.654540 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.654691 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.654836 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.655054 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.655208 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.655398 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.655551 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.655748 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.655902 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.656086 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.656234 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.656387 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.656533 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.656847 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.657000 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.657196 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.657361 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.657548 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.657717 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.657943 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.658094 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.658240 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.658434 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.658554 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.659164 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.659553 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.659668 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.660190 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.660315 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.660536 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.660699 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.660885 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.660990 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.661232 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.661360 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.661603 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.661714 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.661950 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.662052 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.662307 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.662413 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.662660 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.662769 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.663031 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.663146 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.663399 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.663502 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.663752 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.663860 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.664121 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.664222 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.664537 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.664646 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.664910 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.665031 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.665247 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.665350 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.665610 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.665713 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.665948 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.666051 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.666309 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.666428 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.666659 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.666763 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.667023 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.667125 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.667383 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.667494 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.667731 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.667839 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.668088 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.668192 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.668433 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.668543 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.668811 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.668914 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.669161 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.669270 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.669511 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.669623 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.669873 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.669981 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.670217 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.670385 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.670608 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.670758 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.670971 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.671110 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.671358 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.671460 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.671771 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.671873 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.672142 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.672242 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.672486 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.672588 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.672821 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.672923 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.673163 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.673277 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.673506 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.673614 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.673838 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.673941 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.674178 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.674336 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.675092 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.675419 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.675601 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.675758 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.675862 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.676087 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.676189 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.676433 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.676536 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.676799 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.676900 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.677142 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.677243 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.677492 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.677595 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.677841 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.677950 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.678206 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.678339 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.678589 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.678692 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.678930 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.679032 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.679292 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.679399 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.679634 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.679744 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.679967 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.680068 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.680305 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.680407 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.680637 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.680740 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.680978 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.681086 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.681320 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.681430 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.681666 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.681753 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.682006 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.682114 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.682366 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.682487 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.682708 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.682818 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.683071 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.683196 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.683412 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.683534 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.683772 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.683884 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.684115 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.684218 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.684453 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.684555 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.684793 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.684902 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.685131 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.685244 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.685484 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.685582 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.685826 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.685922 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.686162 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.686257 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.686533 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.686628 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.686882 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.686983 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.687224 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.687319 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.687562 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.687656 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.687897 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.688016 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.688255 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.688386 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.688596 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.688707 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.688941 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.689050 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.689288 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.689397 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.689631 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.689798 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.690003 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.690094 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.690363 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.690472 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.690707 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.690812 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.691071 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.691198 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.691414 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.691528 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.691766 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.691861 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.692131 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.692346 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.692502 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.692719 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.692830 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.693071 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.693173 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.693443 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.693534 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.693773 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.693885 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.694137 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.694240 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.694516 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.694620 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.694868 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.694972 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.695218 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.695322 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.695563 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.695658 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.695905 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.696000 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.696261 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.696356 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.696618 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.696712 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.696973 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.697067 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.697347 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.697567 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.697703 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.697938 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.698043 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.698322 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.698430 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.698675 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.698789 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.699030 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.699134 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.699390 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.699499 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.699743 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.699851 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.700095 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.700199 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.700437 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.700539 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.700784 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.700894 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.701128 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.701231 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.701474 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.701577 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.701822 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.701932 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.702200 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.702336 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.702554 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.702673 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.702905 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.703015 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.703255 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.703350 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.703605 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.703709 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.703944 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.704040 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.704318 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.704424 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.704676 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.704770 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.705019 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.705114 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.705360 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.705454 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.706247 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.706592 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.706788 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.706879 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.707116 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.707218 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.707476 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.707580 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.707832 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.707926 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.708192 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.708286 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.708537 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.708640 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.708878 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.708973 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.709236 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.709331 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.709571 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.709674 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.709912 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.710007 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.710262 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.710375 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.710656 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.710750 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.710998 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.711093 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.711345 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.711439 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.711685 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.711780 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.712110 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.712279 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.712426 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.712570 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.712724 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.712956 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.713255 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.713425 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.713723 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.713885 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.714039 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.714186 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.714372 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.714532 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.714679 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.714832 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.715026 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.715179 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.715368 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.715527 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.715754 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.715940 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.716090 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.716235 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.716380 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.716525 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.716671 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.716823 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.717016 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.717169 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.717316 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.717462 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.717663 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.717836 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.717983 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.718134 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.718374 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.718629 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.718796 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.719031 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.719184 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.719330 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.719475 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.719700 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.719860 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.720018 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.720164 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.720356 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.720508 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.720697 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.720857 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.721047 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.721806 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.722006 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.722367 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.722526 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.722685 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.722832 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.722987 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.723132 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.723277 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.723421 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.723631 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.723795 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.724012 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.724162 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.724308 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.724308 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.724601 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.724601 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.724887 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.724887 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.725180 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.725334 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.725486 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.725632 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.725777 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.725938 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.726090 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.726250 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.726439 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.726586 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.726731 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.726877 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.727030 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.727186 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.727331 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.727476 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.727621 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.727771 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.727916 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.728074 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.728229 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.728431 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.728584 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.728746 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.728971 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.729146 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.729363 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.729517 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.729739 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.729897 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.730053 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.730200 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.730411 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.730524 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.730743 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.730847 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.731114 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.731236 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.731447 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.731590 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.731777 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.731880 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.732125 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.732231 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.732467 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.732572 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.732815 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.732925 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.733159 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.733262 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.733497 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.733599 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.733843 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.733954 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.734193 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.734326 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.734575 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.734820 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.734922 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.735203 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.735308 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.735587 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.735680 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.735939 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.736041 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.736295 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.736399 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.736639 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.736742 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.737041 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.737166 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.737365 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.737469 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.737715 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.737817 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.738062 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.738172 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.738449 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.738567 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.738824 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.738927 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.739171 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.739287 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.739526 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.739629 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.739878 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.739979 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.740230 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.740344 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.740579 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.740776 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.740929 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.741151 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.741261 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.741526 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.741630 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.741887 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.741990 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.742233 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.742385 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.742649 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.742754 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.743000 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.743103 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.743354 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.743465 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.743708 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.743810 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.744046 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.744154 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.744391 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.744495 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.744723 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.744825 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.745067 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.745169 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.745432 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.745541 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.745780 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.745883 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.746131 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.746234 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.746549 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.746660 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.746919 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.747022 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.747272 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.747376 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.747618 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.747722 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.747959 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.748062 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.748307 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.748422 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.748655 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.748758 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.749011 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.749114 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.749364 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.749475 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.749705 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.749815 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.750044 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.750147 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.750428 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.750552 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.750772 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.750881 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.751126 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.751228 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.751505 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.751622 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.751812 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.751916 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.752158 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.752261 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.752553 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.752717 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.752937 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.753083 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.753283 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.753386 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.753646 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.753749 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.753992 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.754094 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.754413 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.754525 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.754760 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.754868 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.755111 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.755217 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.755465 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.755559 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.755876 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.755981 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.756150 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.756269 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.756503 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.756607 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.756847 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.756951 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.757194 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.757297 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.757533 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.757644 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.757878 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.757988 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.758222 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.758372 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.758597 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.758711 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.758961 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.759062 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.759314 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.759423 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.759650 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.759764 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.760014 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.760144 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.760360 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.760470 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.760714 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.760825 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.761060 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.761162 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.761401 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.761503 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.761773 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.761876 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.762114 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.762216 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.762489 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.762595 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.762828 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.762937 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.763174 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.763282 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.763519 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.763622 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.763863 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.763967 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.764229 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.764337 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.764597 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.764724 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.764946 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.765048 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.765307 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.765408 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.765659 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.765774 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.766015 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.766117 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.766389 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.766495 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.766749 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.766862 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.767043 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84617) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 16 16:40:46.767148 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.767453 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.767812 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.768699 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.769062 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.769415 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.769772 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.770148 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.770544 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.770914 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.771287 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.771684 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.772039 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.772432 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.772811 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:40:46.773095 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=84616) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 16 16:40:46.803683 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_db.sqlalchemy.engines [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84617) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:40:46.809339 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_db.sqlalchemy.engines [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84616) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:40:47.145717 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.context [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7f43760-3e0c-42c8-aa11-8572e255d551(cell1) {{(pid=84617) load_cells /opt/stack/nova/nova/context.py:466}} Apr 16 16:40:47.151209 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:40:47.153164 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:40:47.154042 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:40:47.154984 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.context [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7f43760-3e0c-42c8-aa11-8572e255d551(cell1) {{(pid=84616) load_cells /opt/stack/nova/nova/context.py:466}} Apr 16 16:40:47.156198 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:40:47.161056 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84616) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:40:47.163038 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84616) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:40:47.165259 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84616) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:40:47.166021 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=84616) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:40:47.179914 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_db.sqlalchemy.engines [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84617) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:40:47.187780 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_db.sqlalchemy.engines [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84617) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:40:47.194423 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_db.sqlalchemy.engines [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84616) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:40:47.195311 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_db.sqlalchemy.engines [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84616) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:40:47.214581 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_db.sqlalchemy.engines [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84617) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:40:47.226371 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_db.sqlalchemy.engines [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=84616) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:40:47.314154 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 16:40:47.314154 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: from cryptography.utils import int_from_bytes Apr 16 16:40:47.314484 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 16:40:47.314484 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: from cryptography.utils import int_from_bytes Apr 16 16:40:47.314484 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 16:40:47.314484 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: from cryptography.utils import int_from_bytes Apr 16 16:40:47.314824 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 16:40:47.314824 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: from cryptography.utils import int_from_bytes Apr 16 16:40:47.391031 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Loading Gnome Apr 16 16:40:47.392038 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Loading Gnome Apr 16 16:40:47.412732 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Loading Google Apr 16 16:40:47.413597 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Loading Google Apr 16 16:40:47.416000 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Loading Windows (alt) Apr 16 16:40:47.416928 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Loading Windows (alt) Apr 16 16:40:47.420540 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Loading file Apr 16 16:40:47.421674 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Loading file Apr 16 16:40:47.421872 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Loading keyczar Apr 16 16:40:47.422358 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Loading multi Apr 16 16:40:47.422806 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Loading keyczar Apr 16 16:40:47.423257 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Loading pyfs Apr 16 16:40:47.423361 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Loading multi Apr 16 16:40:47.424128 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO keyring.backend [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Loading pyfs Apr 16 16:40:47.703015 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: WARNING keystonemiddleware.auth_token [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 16:40:47.705580 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: WARNING keystonemiddleware.auth_token [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 16:40:47.710079 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: WARNING keystonemiddleware.auth_token [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 16:40:47.712788 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: WARNING keystonemiddleware.auth_token [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 16:40:48.043345 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: WARNING keystonemiddleware.auth_token [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 16:40:48.048798 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: WARNING keystonemiddleware.auth_token [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 16:40:48.049091 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: WARNING keystonemiddleware.auth_token [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 16:40:48.055247 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55aee67bb9c0 pid: 84616 (default app) Apr 16 16:40:48.055399 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: WARNING keystonemiddleware.auth_token [None req-88273c49-2585-4d0e-8603-144ba7e06eb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 16:40:48.057481 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:40:48.058707 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] 10.222.0.103 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001818 Apr 16 16:40:48.059143 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 1/1] 10.222.0.103 () {50 vars in 784 bytes} [Fri Apr 16 16:40:48 2021] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:40:48.061747 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55aee67bb9c0 pid: 84617 (default app) Apr 16 16:42:15.093971 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:15.095635 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002130 Apr 16 16:42:15.096210 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 2/2] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:15 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:15.602556 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-984ceb37-6072-497d-a21b-78f15f96d6f6 admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:15.630769 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-984ceb37-6072-497d-a21b-78f15f96d6f6 admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.526513 Apr 16 16:42:15.631535 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 1/3] 10.222.0.103 () {60 vars in 1286 bytes} [Fri Apr 16 16:42:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:42:18.166456 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:18.167640 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-ed79c876-360e-4cd6-be8f-fd2a5c688241 None None] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001554 Apr 16 16:42:18.168348 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 3/4] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:18 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:18.233577 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-f1010a30-e1df-43ce-a3ec-f71f225f88e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:18.258481 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:42:18.258481 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: warnings.warn(msg) Apr 16 16:42:18.285246 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-f1010a30-e1df-43ce-a3ec-f71f225f88e8 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.110130 Apr 16 16:42:18.285840 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 2/5] 10.222.0.103 () {64 vars in 1277 bytes} [Fri Apr 16 16:42:18 2021] POST /compute/v2.1/flavors => generated 409 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:42:18.609721 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-6b579d8b-92a7-49c0-be8f-49c2fb6f0094 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:18.613775 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:42:18.613775 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: warnings.warn(msg) Apr 16 16:42:18.658498 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-6b579d8b-92a7-49c0-be8f-49c2fb6f0094 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.363940 Apr 16 16:42:18.662433 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 4/6] 10.222.0.103 () {64 vars in 1330 bytes} [Fri Apr 16 16:42:18 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:42:21.226877 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-f1010a30-e1df-43ce-a3ec-f71f225f88e8 admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:21.228563 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-f1010a30-e1df-43ce-a3ec-f71f225f88e8 admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002158 Apr 16 16:42:21.228995 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 3/7] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:21 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:21.351649 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-bdf3f94d-6fc9-4e95-b10c-0944e7ae73cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "swap": 0, "ram": 512, "rxtx_factor": 1.0}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:21.375376 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:42:21.375376 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: warnings.warn(msg) Apr 16 16:42:21.401540 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-bdf3f94d-6fc9-4e95-b10c-0944e7ae73cb admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.165944 Apr 16 16:42:21.410219 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 5/8] 10.222.0.103 () {64 vars in 1277 bytes} [Fri Apr 16 16:42:21 2021] POST /compute/v2.1/flavors => generated 406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:42:21.415612 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-99769370-c198-4930-88be-030c5ebffff3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:21.417276 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:42:21.417276 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: warnings.warn(msg) Apr 16 16:42:21.455937 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-99769370-c198-4930-88be-030c5ebffff3 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044379 Apr 16 16:42:21.456864 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 4/9] 10.222.0.103 () {64 vars in 1330 bytes} [Fri Apr 16 16:42:21 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:42:24.056745 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-bdf3f94d-6fc9-4e95-b10c-0944e7ae73cb admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:24.057817 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-bdf3f94d-6fc9-4e95-b10c-0944e7ae73cb admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001547 Apr 16 16:42:24.058498 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 6/10] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:24 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:24.126625 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-e0dadc59-966f-4cc2-bc59-f31645e08576 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:24.156346 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-e0dadc59-966f-4cc2-bc59-f31645e08576 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.090500 Apr 16 16:42:24.157193 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 5/11] 10.222.0.103 () {64 vars in 1277 bytes} [Fri Apr 16 16:42:24 2021] POST /compute/v2.1/flavors => generated 406 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:42:24.171155 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-282c1009-3e40-483b-8fb8-c7b72d989d28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:24.213760 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-282c1009-3e40-483b-8fb8-c7b72d989d28 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045143 Apr 16 16:42:24.215038 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 7/12] 10.222.0.103 () {64 vars in 1330 bytes} [Fri Apr 16 16:42:24 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:42:26.773770 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-e0dadc59-966f-4cc2-bc59-f31645e08576 admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:26.774945 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-e0dadc59-966f-4cc2-bc59-f31645e08576 admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001634 Apr 16 16:42:26.775366 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 6/13] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:26 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:26.840974 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-03d1fdc9-f0fd-4488-ba2b-312b6519ba34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "disk": 10, "id": "d3", "rxtx_factor": 1.0}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:26.867401 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-03d1fdc9-f0fd-4488-ba2b-312b6519ba34 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085702 Apr 16 16:42:26.868219 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 8/14] 10.222.0.103 () {64 vars in 1277 bytes} [Fri Apr 16 16:42:26 2021] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:42:26.880663 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-376436e2-b8c4-40cc-9630-28d282a9acd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:26.916390 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-376436e2-b8c4-40cc-9630-28d282a9acd9 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039603 Apr 16 16:42:26.917132 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 7/15] 10.222.0.103 () {64 vars in 1330 bytes} [Fri Apr 16 16:42:26 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:42:29.459462 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-03d1fdc9-f0fd-4488-ba2b-312b6519ba34 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:29.460600 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-03d1fdc9-f0fd-4488-ba2b-312b6519ba34 admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001570 Apr 16 16:42:29.461037 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 9/16] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:29 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:29.533902 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-ad5ff6d8-00e8-442a-9231-cc3c9f1109eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "ram": 4096, "vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20}} {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:29.567419 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-ad5ff6d8-00e8-442a-9231-cc3c9f1109eb admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.099195 Apr 16 16:42:29.568150 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 8/17] 10.222.0.103 () {64 vars in 1277 bytes} [Fri Apr 16 16:42:29 2021] POST /compute/v2.1/flavors => generated 406 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:42:29.581146 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-6c5ad675-1820-4eba-ab13-ad1938603840 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:29.620025 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-6c5ad675-1820-4eba-ab13-ad1938603840 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042984 Apr 16 16:42:29.620914 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 10/18] 10.222.0.103 () {64 vars in 1330 bytes} [Fri Apr 16 16:42:29 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:42:32.181068 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-ad5ff6d8-00e8-442a-9231-cc3c9f1109eb admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:32.182149 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-ad5ff6d8-00e8-442a-9231-cc3c9f1109eb admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001547 Apr 16 16:42:32.182638 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 9/19] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:32 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:32.251442 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7d1bbd95-b3aa-4606-a55f-23f787ae2ff6 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:32.279150 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-7d1bbd95-b3aa-4606-a55f-23f787ae2ff6 admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.089405 Apr 16 16:42:32.280870 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 11/20] 10.222.0.103 () {60 vars in 1286 bytes} [Fri Apr 16 16:42:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:42:34.853034 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-ad5ff6d8-00e8-442a-9231-cc3c9f1109eb admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:34.854206 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-ad5ff6d8-00e8-442a-9231-cc3c9f1109eb admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001647 Apr 16 16:42:34.854820 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 10/21] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:34 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:42:34.931814 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-e85919b8-2909-4c1f-85a1-c7f111f71f63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:34.956791 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-e85919b8-2909-4c1f-85a1-c7f111f71f63 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094553 Apr 16 16:42:34.957390 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 12/22] 10.222.0.103 () {64 vars in 1277 bytes} [Fri Apr 16 16:42:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:42:34.972470 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-c1dc3c60-af80-4930-a859-dbb12edd9aa9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:35.011439 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-c1dc3c60-af80-4930-a859-dbb12edd9aa9 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043042 Apr 16 16:42:35.012113 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 11/23] 10.222.0.103 () {64 vars in 1327 bytes} [Fri Apr 16 16:42:34 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:42:37.561358 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-e85919b8-2909-4c1f-85a1-c7f111f71f63 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:37.562706 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-e85919b8-2909-4c1f-85a1-c7f111f71f63 admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001546 Apr 16 16:42:37.563673 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 13/24] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:37 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:37.624098 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-1fd1455c-e130-41c8-a644-7e2e1f3b9f3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "ram": 2048, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:37.650023 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-1fd1455c-e130-41c8-a644-7e2e1f3b9f3d admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.079933 Apr 16 16:42:37.650811 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 12/25] 10.222.0.103 () {64 vars in 1277 bytes} [Fri Apr 16 16:42:37 2021] POST /compute/v2.1/flavors => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:42:37.663831 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-b6ac82fa-312a-421e-97b5-660081b85167 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:37.700170 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-b6ac82fa-312a-421e-97b5-660081b85167 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040245 Apr 16 16:42:37.700790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 14/26] 10.222.0.103 () {64 vars in 1327 bytes} [Fri Apr 16 16:42:37 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:42:40.251315 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-1fd1455c-e130-41c8-a644-7e2e1f3b9f3d admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:40.252579 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-1fd1455c-e130-41c8-a644-7e2e1f3b9f3d admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002316 Apr 16 16:42:40.253012 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 13/27] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:40 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:40.314594 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-1fe64967-9cee-491f-bc4f-a486f03aa866 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:40.340526 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-1fe64967-9cee-491f-bc4f-a486f03aa866 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080813 Apr 16 16:42:40.341120 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 15/28] 10.222.0.103 () {64 vars in 1277 bytes} [Fri Apr 16 16:42:40 2021] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:42:40.354546 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-ba9a2168-b5a3-44dc-9304-7cc07e4b6023 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:40.392388 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-ba9a2168-b5a3-44dc-9304-7cc07e4b6023 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041092 Apr 16 16:42:40.394964 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 14/29] 10.222.0.103 () {64 vars in 1327 bytes} [Fri Apr 16 16:42:40 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:42:42.961072 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-1fe64967-9cee-491f-bc4f-a486f03aa866 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:42.962120 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-1fe64967-9cee-491f-bc4f-a486f03aa866 admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001555 Apr 16 16:42:42.966589 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 16/30] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:42 2021] GET /compute/v2.1 => generated 389 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:43.038497 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-13621f96-6426-45a6-8023-4505f91862de admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "4", "name": "m1.large", "ram": 8192, "vcpus": 4}} {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:43.074690 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-13621f96-6426-45a6-8023-4505f91862de admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105417 Apr 16 16:42:43.075543 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 15/31] 10.222.0.103 () {64 vars in 1277 bytes} [Fri Apr 16 16:42:42 2021] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:42:43.090700 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-2d840c13-7239-42cf-a970-ba0ff196f759 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:43.138200 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-2d840c13-7239-42cf-a970-ba0ff196f759 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053115 Apr 16 16:42:43.139311 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 17/32] 10.222.0.103 () {64 vars in 1327 bytes} [Fri Apr 16 16:42:43 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:42:45.692129 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-13621f96-6426-45a6-8023-4505f91862de admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:42:45.693296 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-13621f96-6426-45a6-8023-4505f91862de admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001551 Apr 16 16:42:45.693907 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 16/33] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:42:45 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:42:45.761879 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-94d1f67b-aa72-410c-914c-cddd1854219c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:45.787796 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-94d1f67b-aa72-410c-914c-cddd1854219c admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.087448 Apr 16 16:42:45.788629 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 18/34] 10.222.0.103 () {64 vars in 1277 bytes} [Fri Apr 16 16:42:45 2021] POST /compute/v2.1/flavors => generated 410 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:42:45.803391 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-127f36c4-a991-4329-b250-a4f7fe83e31c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:42:45.842133 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-127f36c4-a991-4329-b250-a4f7fe83e31c admin admin] 10.222.0.103 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042605 Apr 16 16:42:45.842818 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 17/35] 10.222.0.103 () {64 vars in 1327 bytes} [Fri Apr 16 16:42:45 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:43:27.477242 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-94d1f67b-aa72-410c-914c-cddd1854219c admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:27.478325 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-94d1f67b-aa72-410c-914c-cddd1854219c admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001518 Apr 16 16:43:27.478789 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 19/36] 10.222.0.103 () {54 vars in 925 bytes} [Fri Apr 16 16:43:27 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:43:27.541214 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-598b10a6-9bbb-4cbb-bf2d-af8f76c5f0d9 admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:27.566592 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-598b10a6-9bbb-4cbb-bf2d-af8f76c5f0d9 admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.080437 Apr 16 16:43:27.567160 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 18/37] 10.222.0.103 () {60 vars in 1286 bytes} [Fri Apr 16 16:43:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:43:29.233378 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-94d1f67b-aa72-410c-914c-cddd1854219c admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:29.234465 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-94d1f67b-aa72-410c-914c-cddd1854219c admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001503 Apr 16 16:43:29.234921 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 20/38] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:43:29 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:43:29.419310 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-c3058b13-f980-4482-84e6-e207c0c85b6c admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:29.434017 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.wsgi [None req-c3058b13-f980-4482-84e6-e207c0c85b6c admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 16 16:43:29.434700 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-c3058b13-f980-4482-84e6-e207c0c85b6c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=84617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:43:29.435558 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-c3058b13-f980-4482-84e6-e207c0c85b6c admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.071850 Apr 16 16:43:29.436116 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 19/39] 10.222.0.103 () {60 vars in 1186 bytes} [Fri Apr 16 16:43:29 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 16:43:29.446755 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7013ca2e-7b25-4d0b-ad6e-db5496bab410 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:29.468352 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-7013ca2e-7b25-4d0b-ad6e-db5496bab410 admin admin] 10.222.0.103 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.025563 Apr 16 16:43:29.468924 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 21/40] 10.222.0.103 () {60 vars in 1206 bytes} [Fri Apr 16 16:43:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:43:29.479416 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-ed194733-10dc-4d28-ba34-32b08aacf914 admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:29.501718 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-ed194733-10dc-4d28-ba34-32b08aacf914 admin admin] 10.222.0.103 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.026043 Apr 16 16:43:29.502315 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 20/41] 10.222.0.103 () {60 vars in 1206 bytes} [Fri Apr 16 16:43:29 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:43:29.512280 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-fd389096-279f-402d-9cb5-86f70d5c738a admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:29.526874 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.wsgi [None req-fd389096-279f-402d-9cb5-86f70d5c738a admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 16 16:43:29.527511 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-fd389096-279f-402d-9cb5-86f70d5c738a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=84616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:43:29.528362 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-fd389096-279f-402d-9cb5-86f70d5c738a admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.019957 Apr 16 16:43:29.528912 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 22/42] 10.222.0.103 () {60 vars in 1186 bytes} [Fri Apr 16 16:43:29 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 16:43:31.113088 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-ed194733-10dc-4d28-ba34-32b08aacf914 admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:31.114210 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-ed194733-10dc-4d28-ba34-32b08aacf914 admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001573 Apr 16 16:43:31.114703 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 21/43] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:43:31 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:43:31.299862 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-c519cd52-53bc-4ee4-9c85-671d66bd5e46 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:31.312687 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.wsgi [None req-c519cd52-53bc-4ee4-9c85-671d66bd5e46 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 16 16:43:31.313337 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-c519cd52-53bc-4ee4-9c85-671d66bd5e46 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=84616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:43:31.314173 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-c519cd52-53bc-4ee4-9c85-671d66bd5e46 admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.069695 Apr 16 16:43:31.314793 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 23/44] 10.222.0.103 () {60 vars in 1186 bytes} [Fri Apr 16 16:43:31 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 16:43:31.324989 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-2bd3367b-598b-49a2-b6e0-ffa3ab265141 admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:31.346947 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-2bd3367b-598b-49a2-b6e0-ffa3ab265141 admin admin] 10.222.0.103 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.025993 Apr 16 16:43:31.347515 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 22/45] 10.222.0.103 () {60 vars in 1206 bytes} [Fri Apr 16 16:43:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:43:31.357648 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-b6dad0de-6127-42f1-9be8-c382d422cd92 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:31.379821 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-b6dad0de-6127-42f1-9be8-c382d422cd92 admin admin] 10.222.0.103 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.025878 Apr 16 16:43:31.380415 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 24/46] 10.222.0.103 () {60 vars in 1206 bytes} [Fri Apr 16 16:43:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:43:31.390804 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-8c4dc090-95b1-46e4-a8ee-331cfbc3937f admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:31.403744 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.wsgi [None req-8c4dc090-95b1-46e4-a8ee-331cfbc3937f admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 16 16:43:31.404358 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-8c4dc090-95b1-46e4-a8ee-331cfbc3937f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=84617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:43:31.405196 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-8c4dc090-95b1-46e4-a8ee-331cfbc3937f admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018394 Apr 16 16:43:31.405735 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 23/47] 10.222.0.103 () {60 vars in 1186 bytes} [Fri Apr 16 16:43:31 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 16:43:32.968746 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-b6dad0de-6127-42f1-9be8-c382d422cd92 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:32.969928 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-b6dad0de-6127-42f1-9be8-c382d422cd92 admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001629 Apr 16 16:43:32.970385 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 25/48] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:43:32 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:43:33.152654 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-57cbe9f0-c53b-4cbd-b5bc-1ac38e3c4bdc admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:33.165547 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.wsgi [None req-57cbe9f0-c53b-4cbd-b5bc-1ac38e3c4bdc admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 16 16:43:33.166156 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-57cbe9f0-c53b-4cbd-b5bc-1ac38e3c4bdc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=84617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:43:33.167044 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-57cbe9f0-c53b-4cbd-b5bc-1ac38e3c4bdc admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.069732 Apr 16 16:43:33.167590 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 24/49] 10.222.0.103 () {60 vars in 1189 bytes} [Fri Apr 16 16:43:33 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 16:43:33.178768 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-0acbadf9-595d-487d-8010-75e17f1586fd admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:33.200934 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-0acbadf9-595d-487d-8010-75e17f1586fd admin admin] 10.222.0.103 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.026431 Apr 16 16:43:33.201504 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 26/50] 10.222.0.103 () {60 vars in 1206 bytes} [Fri Apr 16 16:43:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:43:33.211469 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:33.232418 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] 10.222.0.103 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.024629 Apr 16 16:43:33.232982 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 25/51] 10.222.0.103 () {60 vars in 1206 bytes} [Fri Apr 16 16:43:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:43:33.243495 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7d38eb13-8e37-4270-8497-a56466ee5aec admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:33.257056 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.wsgi [None req-7d38eb13-8e37-4270-8497-a56466ee5aec admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 16 16:43:33.257666 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7d38eb13-8e37-4270-8497-a56466ee5aec admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=84616) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:43:33.258531 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-7d38eb13-8e37-4270-8497-a56466ee5aec admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018931 Apr 16 16:43:33.259067 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 27/52] 10.222.0.103 () {60 vars in 1189 bytes} [Fri Apr 16 16:43:33 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 16:43:34.838821 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:34.839889 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001549 Apr 16 16:43:34.840322 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 26/53] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:43:34 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:43:35.023721 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-03e5a26c-ec0a-4076-b721-e4d4089b71fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:43:35.048932 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-03e5a26c-ec0a-4076-b721-e4d4089b71fa admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.88 time: 0.080173 Apr 16 16:43:35.049527 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 28/54] 10.222.0.103 () {64 vars in 1231 bytes} [Fri Apr 16 16:43:34 2021] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:43:36.631472 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:36.632549 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001537 Apr 16 16:43:36.632992 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 27/55] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:43:36 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:43:36.815089 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-95b2e78e-b966-4382-86f1-9a445a36588f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:43:36.838732 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-95b2e78e-b966-4382-86f1-9a445a36588f admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.077742 Apr 16 16:43:36.839257 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 29/56] 10.222.0.103 () {64 vars in 1231 bytes} [Fri Apr 16 16:43:36 2021] POST /compute/v2.1/flavors => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:43:38.401760 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:38.402855 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001540 Apr 16 16:43:38.403274 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 28/57] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:43:38 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:43:38.584378 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-ebb161e6-7361-4bf2-a82b-9e842605a034 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:43:38.609364 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-ebb161e6-7361-4bf2-a82b-9e842605a034 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.078567 Apr 16 16:43:38.609894 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 30/58] 10.222.0.103 () {64 vars in 1231 bytes} [Fri Apr 16 16:43:38 2021] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:43:40.177488 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:40.178574 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001514 Apr 16 16:43:40.179013 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 29/59] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:43:40 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:43:40.366135 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-43736d97-2ece-4d62-b7b3-d23bf9f50727 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:43:40.392647 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-43736d97-2ece-4d62-b7b3-d23bf9f50727 admin admin] 10.222.0.103 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.88 time: 0.080931 Apr 16 16:43:40.393223 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 31/60] 10.222.0.103 () {64 vars in 1231 bytes} [Fri Apr 16 16:43:40 2021] POST /compute/v2.1/flavors => generated 411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:43:41.980764 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:41.981821 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001506 Apr 16 16:43:41.982253 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 30/61] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:43:41 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:43:42.167277 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-79929c5d-f348-4111-b886-628e53d72b46 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:43:42.196300 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-79929c5d-f348-4111-b886-628e53d72b46 admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.88 time: 0.083056 Apr 16 16:43:42.196820 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 32/62] 10.222.0.103 () {60 vars in 1198 bytes} [Fri Apr 16 16:43:42 2021] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:44:33.767003 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:44:33.768055 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-7f598881-bf00-48b2-afca-0eb375a9dbfa admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001550 Apr 16 16:44:33.768494 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 31/63] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:44:33 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:44:33.951112 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-721ae5c5-09f5-4bac-9ec5-5317a0ab0e35 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:44:33.979424 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-721ae5c5-09f5-4bac-9ec5-5317a0ab0e35 admin admin] 10.222.0.103 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.88 time: 0.083121 Apr 16 16:44:33.979940 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 33/64] 10.222.0.103 () {60 vars in 1198 bytes} [Fri Apr 16 16:44:33 2021] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:46:02.821579 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-8fcaca14-9607-4646-8d8b-1b3c25728814 tempest-verify_tempest_config-562981307 tempest-verify_tempest_config-562981307-project] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:46:02.823650 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-8fcaca14-9607-4646-8d8b-1b3c25728814 tempest-verify_tempest_config-562981307 tempest-verify_tempest_config-562981307-project] 10.222.0.103 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121542 Apr 16 16:46:02.824229 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 32/65] 10.222.0.103 () {58 vars in 1129 bytes} [Fri Apr 16 16:46:02 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:47:43.516919 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-721ae5c5-09f5-4bac-9ec5-5317a0ab0e35 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:47:43.517978 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-721ae5c5-09f5-4bac-9ec5-5317a0ab0e35 admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001524 Apr 16 16:47:43.518442 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 34/66] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:47:43 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:47:43.777194 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-580b151e-2b9d-495d-b696-44780f94adbe admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:47:43.778540 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:47:43.778540 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: warnings.warn(msg) Apr 16 16:47:43.780428 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-580b151e-2b9d-495d-b696-44780f94adbe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:47:43.780912 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-580b151e-2b9d-495d-b696-44780f94adbe admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:47:43.782438 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-580b151e-2b9d-495d-b696-44780f94adbe admin admin] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:47:43.782916 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-580b151e-2b9d-495d-b696-44780f94adbe admin admin] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:47:43.820938 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-580b151e-2b9d-495d-b696-44780f94adbe admin admin] 10.222.0.103 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.88 time: 0.173359 Apr 16 16:47:43.821533 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 33/67] 10.222.0.103 () {60 vars in 1189 bytes} [Fri Apr 16 16:47:43 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:47:45.407918 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-721ae5c5-09f5-4bac-9ec5-5317a0ab0e35 admin admin] Calling method '>' {{(pid=84616) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:47:45.408981 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-721ae5c5-09f5-4bac-9ec5-5317a0ab0e35 admin admin] 10.222.0.103 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001532 Apr 16 16:47:45.409413 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84616|app: 0|req: 35/68] 10.222.0.103 () {56 vars in 1070 bytes} [Fri Apr 16 16:47:45 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:47:45.595446 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG nova.api.openstack.wsgi [None req-39b852ef-c8ed-4709-b849-ea54532d2612 admin admin] Calling method '>' {{(pid=84617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:47:45.596749 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:47:45.596749 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: warnings.warn(msg) Apr 16 16:47:45.598418 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-39b852ef-c8ed-4709-b849-ea54532d2612 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:47:45.598915 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-39b852ef-c8ed-4709-b849-ea54532d2612 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:47:45.599790 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-39b852ef-c8ed-4709-b849-ea54532d2612 admin admin] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:47:45.600271 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: DEBUG oslo_concurrency.lockutils [None req-39b852ef-c8ed-4709-b849-ea54532d2612 admin admin] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=84617) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:47:45.629216 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: INFO nova.api.openstack.requestlog [None req-39b852ef-c8ed-4709-b849-ea54532d2612 admin admin] 10.222.0.103 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.88 time: 0.088753 Apr 16 16:47:45.629763 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: [pid: 84617|app: 0|req: 34/69] 10.222.0.103 () {60 vars in 1189 bytes} [Fri Apr 16 16:47:45 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:48:46.419073 dv-cinder-733622-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 16 16:48:46.419959 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: Fri Apr 16 16:48:46 2021 - graceful shutdown triggered... Apr 16 16:48:46.420395 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: Gracefully killing worker 1 (pid: 84616)... Apr 16 16:48:46.420486 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: Gracefully killing worker 2 (pid: 84617)... Apr 16 16:48:47.421191 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: worker 1 buried after 1 seconds Apr 16 16:48:47.421191 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: worker 2 buried after 1 seconds Apr 16 16:48:47.421191 dv-cinder-733622-13-iscsi devstack@n-api.service[84615]: goodbye to uWSGI. Apr 16 16:48:47.422881 dv-cinder-733622-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 16 16:48:47.424562 dv-cinder-733622-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 16 16:48:47.432546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: *** Starting uWSGI 2.0.15-debian (64bit) on [Fri Apr 16 16:48:47 2021] *** Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: nodename: dv-cinder-733622-13-iscsi Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: machine: x86_64 Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: clock source: unix Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: pcre jit disabled Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: detected number of CPU cores: 4 Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: current working directory: / Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: detected binary path: /usr/bin/uwsgi-core Apr 16 16:48:47.434563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: dropping root privileges as early as possible Apr 16 16:48:47.435581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: your processes number limit is 47843 Apr 16 16:48:47.435581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: your memory page size is 4096 bytes Apr 16 16:48:47.435581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: detected max file descriptor number: 2048 Apr 16 16:48:47.435581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: lock engine: pthread robust mutexes Apr 16 16:48:47.435581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: thunder lock: enabled Apr 16 16:48:47.435581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 16 16:48:47.435581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: dropping root privileges after socket binding Apr 16 16:48:47.435581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 16 16:48:47.481652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Python main interpreter initialized at 0x5569013c39c0 Apr 16 16:48:47.481652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: dropping root privileges after plugin initialization Apr 16 16:48:47.481652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: python threads support enabled Apr 16 16:48:47.481652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: your server socket listen backlog is limited to 100 connections Apr 16 16:48:47.481652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: your mercy for graceful operations on workers is 90 seconds Apr 16 16:48:47.482236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: mapped 402621 bytes (393 KB) for 2 cores Apr 16 16:48:47.482236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: *** Operational MODE: preforking *** Apr 16 16:48:47.482480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: dropping root privileges after application loading Apr 16 16:48:47.482480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: *** uWSGI is running in multiple interpreter mode *** Apr 16 16:48:47.482480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: spawned uWSGI master process (pid: 99396) Apr 16 16:48:47.482772 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: spawned uWSGI worker 1 (pid: 99398, cores: 1) Apr 16 16:48:47.482503 dv-cinder-733622-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 16 16:48:47.487086 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: spawned uWSGI worker 2 (pid: 99399, cores: 1) Apr 16 16:48:47.487086 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 16 16:48:52.754274 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 16 16:48:52.755080 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 16 16:48:52.756782 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 16 16:48:52.757248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 16 16:48:52.757550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 16 16:48:52.758027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.758433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.758809 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.759176 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.759565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.759904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.760275 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.760640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.761024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.761328 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.761692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.762070 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733622-13-iscsi {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.762473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.762831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.763185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.763557 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.763909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.764288 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.764822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.765243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.765600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.765952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.766378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.766738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.767098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.767454 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.767829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.768191 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.768567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.768920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.769299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733622-13-iscsi {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.769708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.770031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.770436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.770960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.771960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.772450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.772811 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.773196 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.773551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.773941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.774363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.774718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.775092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.775443 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.775798 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.776157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.776537 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.776889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.777238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.777532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.777884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.778261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.778660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.779306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.779579 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.779867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.780237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.780612 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.780975 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.781475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.781658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.782007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.782381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.782733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.783085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.783435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.783808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.784170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.784595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.784895 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.785266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.785735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.103 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.785856 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 16 16:48:52.786026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.103 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.786170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 16 16:48:52.786404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.786870 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.787228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.787581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.787949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.788071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 16 16:48:52.788321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.788433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 16 16:48:52.788673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.788789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 16 16:48:52.789021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.789138 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.789370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.789480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.789741 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.789870 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.790117 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.790217 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.790494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.790621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.790789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.790883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.791136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.791972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.792075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.792153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.792232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.792311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.792390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.792472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.792552 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.792625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.792790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.792882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733622-13-iscsi {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.793115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.793224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.793461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.793551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.793813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.793898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.794158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.794243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.794528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.795653 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.795653 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.795822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.795934 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.796043 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.796149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.796249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.796359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.796465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.796579 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.796699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.796833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.796934 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.797051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.797163 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.797263 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.797477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.797626 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.797818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.797980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.798169 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.798273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.799264 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.799370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.799448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.799522 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.799609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.799707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.799819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733622-13-iscsi {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.799931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.800043 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.800147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.800240 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.800341 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.800532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.800678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.800982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.801115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.801333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.801461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.801675 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.801800 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.802018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.802145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.802415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.802565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.802787 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.803066 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.803173 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.803454 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.803562 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.803801 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.803917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.804147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.804254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.804492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.804606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.804832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.804947 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.805169 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.805287 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.805512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.805633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.805851 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.805959 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.806197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.806376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.806594 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.806707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.806880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.807002 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.807231 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.807359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.807580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.807688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.807954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.808142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.808301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.808481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.808649 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.808824 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.808984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.809138 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.809312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.809465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.809617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.809781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.809933 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.810087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.810259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.810465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.810571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.810825 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.810928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.811164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.811273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.811511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.811620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.811857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.811969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.812204 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.812315 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.812559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.812667 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.812915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.813037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.813271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.813386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.813608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.813710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.813979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.814117 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.814332 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.814455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.103 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.814693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.814807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.103 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.815045 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.815152 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.815398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.815505 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.815773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.815879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.816119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.816370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.816480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.816582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.816866 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.817752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.818597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.818712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.818793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.818868 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.818965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.819051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.819051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.819209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.819287 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.819361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.819611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.819717 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.819928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.820030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.820289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.820377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.820656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.820750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.821007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.821113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.821357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.821455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.821710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.821803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.822064 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.822186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.822569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.822721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.822926 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.823055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.823356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.823491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.823607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.823731 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.823955 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.824104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.824332 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.824461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.824627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.824757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.824977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.825108 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.825326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.825463 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.825673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.825795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.826043 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.826191 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.826429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.826555 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.826775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.826932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.827123 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.827294 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.827537 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.827711 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.827942 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.828092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.828237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.828391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.828543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.828688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.828970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.829140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.829289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.829443 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.829604 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.829763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.829922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.830069 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.830224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.830410 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.830566 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.830712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.830855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.831008 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.831160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.831306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.831450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.831609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.831762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.831919 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.832071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.832456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.832615 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.832773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.832928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.833083 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.833235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.833404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.833687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.834552 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.834838 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.835010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.835164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.835317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.835463 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.835607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.835758 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.835914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.836059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.836211 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.836364 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.836515 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.836673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.836826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.836977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.837133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.837284 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.837522 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.837758 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.837931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.838154 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 16 16:48:52.838324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.838484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.838638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.838796 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.838941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.839100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.839253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.839400 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.839552 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.839704 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.839856 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.840000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.840143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.840286 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.840439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.840439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.840715 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.840715 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.841005 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.841158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.841315 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.841466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.841617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.841768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.841913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.842056 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.842209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.842376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.842612 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.842761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.842926 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.843079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.843233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.843393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.843539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.843775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.843939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.844093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.844238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.844388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.844548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.844784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.844941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.845106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.845258 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.845409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.845554 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.845707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.845860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.846013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.846164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.846389 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.846543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.846687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.846833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.847063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.847227 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.847418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.847577 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.847820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.847978 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.848153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.848379 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.848542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.848699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.848857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.849071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.849265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.849481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.849481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.849939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.850096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.850255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.850438 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.850588 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.850737 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.850896 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.851048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.851205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.851356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.851511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.851671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.851821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.851971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.852137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.852288 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.852436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.852602 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.852836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.853006 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.853172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.853329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.853495 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.853647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.853892 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.854065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.854222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.854405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.854566 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.854733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.854994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.855165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.855328 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.855625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.855816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.855988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.855988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.856302 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.856453 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.856609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.856766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.856930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.857088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.857250 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.857408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.857557 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.857706 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.857878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.858113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.858270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.858613 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.858765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.858914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.859063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.859228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.859388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.859539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.859688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.859926 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.860113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.860280 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.860433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.860589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.860748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.860904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.861065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.861228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.861385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.861535 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.861684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.861833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.861993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.862149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.862318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.862490 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.862737 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.862987 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.863155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.863313 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.863598 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.863760 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.863926 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.864158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.864322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.864480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.864631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.864811 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.864811 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.865232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.865399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.865549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.865699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.865699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.865993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.866142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.866323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.866479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.866784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.866951 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.867102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.867265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.867431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.867582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.867582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.867868 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.868017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.868263 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.868263 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.868656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.868656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.868958 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.868958 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.869258 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.869415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.869581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.869738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.869889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.870045 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.870203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.870378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.870528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.870678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.870828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.870828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.871136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.871293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.871443 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.871600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.871750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.871914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.872064 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.872221 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.872371 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.872526 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.872682 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.872840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.873006 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.873235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.873396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.873546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.873710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.873872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.874030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.874237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.874466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.874629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.874785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.874944 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.875102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.875267 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.875512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.875673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.875833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.876003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.876154 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.876303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.876453 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.876611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.876787 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.877016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.877180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.877337 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.877487 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.877635 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.877798 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.877964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.878121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.878302 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.878536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.878783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.878948 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.879224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.879384 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.879534 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.879682 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.879831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.879988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.880182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.880859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.881058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.881211 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.881446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.881650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.881810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.881810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.882103 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.882261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.882453 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.882611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.882769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.882925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.883091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.883260 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.883501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.883501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.883803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.883960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.884116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.884273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.884431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.884589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.884739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.884895 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.885044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.885203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.885361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.885721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.885887 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.886038 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.886189 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.886427 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.886585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.886735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.886890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.887127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.887291 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.887450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.887619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.887776 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.887933 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.888083 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.888239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.888397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.888562 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.888562 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.889017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.889171 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.889327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.889485 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.889642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.889642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.889946 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.890101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.890260 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.890434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.890584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.890735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.890894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.891051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.891209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.891366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.891517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.891675 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.891832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.891989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.891989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.892295 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.892445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.892600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.892750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.892907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.893064 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.893223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.893380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.893617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.893791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.893955 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.893955 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.894247 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.894419 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.894570 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.894848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.895013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.895175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.895333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.895333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.895626 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.895893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.896069 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.896069 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.896431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.897109 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.897376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.897533 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.897692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.897850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.898001 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.898001 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.898365 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.898534 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.898696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.898696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.899201 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.899201 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.899503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.899662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.899813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.899963 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.900112 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.900112 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.900406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.900564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.900721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.900888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.901137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.901301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.901458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.901622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.901779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.901929 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.902079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.902227 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.902401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.902563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.902722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.902879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.903031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.903217 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.903370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.903530 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.904045 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.904045 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.904349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.904508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.904670 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.904826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.904976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.905133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.905291 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.905451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.905613 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.905771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.905922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.906077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.906351 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.906521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.906681 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.906845 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.906996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.907152 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.907309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.907561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.907739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.907892 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.908048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.908048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.908341 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.908498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.908657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.908814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.908987 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.909239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.909480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.909657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.909815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.909982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.910139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.910499 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.910666 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.910831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.910982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.911138 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.911293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.911452 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.911452 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.911907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.912072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.912222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.912382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.912532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.912689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.912853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.912853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.913147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.913147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.913449 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.913667 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.913819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.913976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.914241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.914430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.914598 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.914757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.914915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.915063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.915213 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.915362 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.915510 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.915671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.915827 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.915984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.916133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.916282 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.916548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.916727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.916884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.917035 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.917184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.917333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.917333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.917733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.917898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.918051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.918207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.918389 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.918550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.918709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.918872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.919022 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.919172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.919432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.919746 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.919898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.920047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.920204 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.920361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.920521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.920680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.920837 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.921006 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.921157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.921307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.921456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.921614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.921764 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.921913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.922062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.922219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.922429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.922583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.922739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.922895 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.923064 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.923222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.923222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.923529 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.923685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.923835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.923990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.924147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.924405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.924563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.924719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.924876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.925026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.925191 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.925358 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.925508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.925656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.925656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.926099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.926273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.926462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.926729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.926729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.927030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.927180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.927367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.927535 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.927706 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.927940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.927940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.928245 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.928403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.928560 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.928732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.928994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.929172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.929333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.929585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.929833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.930005 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.930156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.930331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.930496 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.930657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.930808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.930957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.931113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.931263 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.931425 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.931575 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.931726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.931884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.931884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.932178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.932339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.932497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.932655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.932813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.932972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.933123 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.933284 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.933435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.933435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.933734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.933893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.934043 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.934200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.934545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.934711 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.934869 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.935019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.935181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.935181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.935472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.935620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.935777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.935927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.936097 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.936247 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.936402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.936559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.936732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.936982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.937147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.937303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.937452 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.937601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.937750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.937920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.938157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.938351 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.938509 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.938668 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.938817 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.938973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.939136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.939285 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.939434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.939605 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.939852 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.940092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.940249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.940404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.940627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.940785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.940785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.941082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.941233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.941382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.941657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.941816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.941973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.942132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.942436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.942590 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.942749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.943441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.943660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.943828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.943979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.944127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.944277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.944433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.944694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.944851 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.945008 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.945158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.945308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.945466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.945685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.945836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.945995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.946152 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.946382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.946550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.946713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.946871 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.947140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.947296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.947455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.947605 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.947774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.947925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.948080 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.948327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.948492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.948648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.948807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.948957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.949104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.949253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.949401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.949563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.949730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.950120 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.950382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.950543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.950693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.950850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.951007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.951164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.951314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.951314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.951608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.951804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.952009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.952160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.952325 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.952485 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.952637 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.952793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.952949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.953108 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.953275 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.953441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.953594 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.953745 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.953893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.954053 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.954222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.954397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.954548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.954723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.954958 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.955113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.955273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.955423 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.955573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.955780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.956013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.956186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.956339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.956498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.956647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.956806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.956964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.957143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.957394 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.957559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.957559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.957846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.958003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.958161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.958336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.959170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.959482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.959643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.959836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.960009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.960369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.960606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.960606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.960900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.961068 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.961223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.961380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.961541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.961690 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.961838 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.961996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.962147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.962432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.962597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.962863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.963032 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.963201 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.963367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.963519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.963668 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.963827 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.963983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.964133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.964283 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.964439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.964596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.964747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.964904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.965159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.965324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.965473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.965629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.965629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.965981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.966141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.966324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.966481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.966642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.966801 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.966964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.967119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.967275 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.967532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.967695 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.967858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.968019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.968176 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.968333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.968484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.968719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.968889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.969047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.969205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.969355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.969512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.969662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.969819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.969969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.970130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.970308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.970550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.970802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.970971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.971129 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.971297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.971634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.971799 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.971965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.972115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.972115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.972401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.972569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.972720 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.972881 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.973048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.973203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.973360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.973509 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.973660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.973820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.973976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.974180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.974424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.974581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.974581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.975074 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.975337 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.975503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.975503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.975804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.975954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.976116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.976273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.976430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.976586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.976737 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.976894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.977055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.977205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.977360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.977509 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.977768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.977934 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.978085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.978236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.978410 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.978571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.978738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.978972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.979138 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.979288 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.979443 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.979593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.979754 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.979906 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.980055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.980203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.980359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.980537 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.980786 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.981017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.981179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.981340 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.981497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.981648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.981806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.981955 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.982104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.982210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.982370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.982729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.982961 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.983131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.983324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.983501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.983700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.983873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.984027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.984136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.984394 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.984498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.984749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.984866 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.985101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.985276 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.985475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.985596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.985787 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.985885 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.986148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.986239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.986524 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.986622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.986872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.986957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.987227 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.987311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.987607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.987698 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.987987 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.988230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.988352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.988619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.988704 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.989011 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.989119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.989361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.989447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.990261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.990601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.990914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.991173 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.991345 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.991498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.991652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.991816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.991982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.992144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.992297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.992457 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.992546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.992676 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.992872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.993034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.993220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.993390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.993565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.993747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.993915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.994106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.994262 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.994490 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.994657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.994848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.995024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.995204 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.995374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.995586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.995689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.995939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.996026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.996305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.996391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.996671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.996955 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.997051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.997360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.997445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.997714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.997799 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.998067 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:52.998180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.006023 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.006238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.006558 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.006912 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.007254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.007714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.007927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.008180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.008180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.008799 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.009047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.009256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.009468 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.009847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.010214 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.010520 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.010781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.011130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.011510 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.012375 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.012584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.012776 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.013006 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.013343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.013728 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.013930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.014108 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.014108 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.014451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.014614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.014771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.014931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.018414 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.018649 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.018882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.019157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.019375 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.019536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.019765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020283 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020490 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.020819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.022455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.022620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.022792 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.023000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.023000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.023308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.023460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.023616 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.023616 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.023928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.024085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.024260 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.024421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.024578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.024735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.024894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.025053 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.025248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.025438 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.025620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.025773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.025930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.026087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.026257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.026455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.026614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.026773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.026930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.026930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.027246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.027402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.027558 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.027558 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.027858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.028008 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.028159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.028325 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.028476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.028934 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.029098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.029250 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.029406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.029565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.029716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.029876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.030034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.030193 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.030380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.030542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.030714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.030872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.031033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.034440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.034669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.034848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.035023 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.035187 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.035348 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.035503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.035665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.035818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.035983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.036157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.036369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.036531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.036777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.036964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.037161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.037320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.037473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.037631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.037791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.037957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.038119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.038309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.038486 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.038649 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.038802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.038969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.039121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.039282 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.039447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.039606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.039761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.039978 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.040137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.040289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.040455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.040615 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.040783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.040935 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.041098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.041275 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.041482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.041645 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.041828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.042050 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.042215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.042403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.042572 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.042724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.042890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.046384 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.046575 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.046739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.046897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.047062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.047230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.047391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.047558 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.047718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.047876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.048047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.048199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.048360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.048520 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.048678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.048837 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.049002 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.049157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99399) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 16 16:48:53.049309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.049309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.049309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.049309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.049309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.049309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.049309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.049309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.050578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.050578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.050578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.050578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.050578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.050578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.050578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.050578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.051876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.051876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.051876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.051876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.051876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.051876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.051876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.051876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.054907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.054907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.054907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.054907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.054907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.054907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.054907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.054907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.055883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.055883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.055883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.055883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.055883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.055883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.055883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.055883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.056771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.056771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.056771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.056771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.056771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.056771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.056771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.056771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.057620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.057620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.057620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.057620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.057620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.058116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.058219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.059175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.059521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.059910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 16 16:48:53.060500 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=99398) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 16 16:48:53.084761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_db.sqlalchemy.engines [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99399) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:48:53.099923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_db.sqlalchemy.engines [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99398) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:48:53.355853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.context [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7f43760-3e0c-42c8-aa11-8572e255d551(cell1) {{(pid=99399) load_cells /opt/stack/nova/nova/context.py:466}} Apr 16 16:48:53.363985 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:48:53.366643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:48:53.367441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:48:53.369658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:48:53.376150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.context [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7f43760-3e0c-42c8-aa11-8572e255d551(cell1) {{(pid=99398) load_cells /opt/stack/nova/nova/context.py:466}} Apr 16 16:48:53.380820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:48:53.382777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:48:53.383701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:48:53.386146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:48:53.398931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_db.sqlalchemy.engines [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99399) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:48:53.399994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_db.sqlalchemy.engines [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99399) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:48:53.422526 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_db.sqlalchemy.engines [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99398) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:48:53.423744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_db.sqlalchemy.engines [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99398) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:48:53.438672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_db.sqlalchemy.engines [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99399) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:48:53.460583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_db.sqlalchemy.engines [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=99398) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 16 16:48:53.526131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 16:48:53.526131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: from cryptography.utils import int_from_bytes Apr 16 16:48:53.526506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 16:48:53.526506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: from cryptography.utils import int_from_bytes Apr 16 16:48:53.545701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 16:48:53.545701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: from cryptography.utils import int_from_bytes Apr 16 16:48:53.546082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 16:48:53.546082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: from cryptography.utils import int_from_bytes Apr 16 16:48:53.605345 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Loading Gnome Apr 16 16:48:53.625075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Loading Gnome Apr 16 16:48:53.627224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Loading Google Apr 16 16:48:53.630626 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Loading Windows (alt) Apr 16 16:48:53.635448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Loading file Apr 16 16:48:53.636534 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Loading keyczar Apr 16 16:48:53.636983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Loading multi Apr 16 16:48:53.637857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Loading pyfs Apr 16 16:48:53.645932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Loading Google Apr 16 16:48:53.649544 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Loading Windows (alt) Apr 16 16:48:53.654740 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Loading file Apr 16 16:48:53.655857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Loading keyczar Apr 16 16:48:53.656319 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Loading multi Apr 16 16:48:53.657207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO keyring.backend [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Loading pyfs Apr 16 16:48:53.922615 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: WARNING keystonemiddleware.auth_token [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 16:48:53.930175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: WARNING keystonemiddleware.auth_token [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 16:48:53.944775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: WARNING keystonemiddleware.auth_token [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 16:48:53.951976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: WARNING keystonemiddleware.auth_token [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 16:48:54.279881 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: WARNING keystonemiddleware.auth_token [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 16:48:54.285759 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: WARNING keystonemiddleware.auth_token [None req-5b7f4470-bff0-4f4d-8b36-eefb78d55d84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 16:48:54.292000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5569013c39c0 pid: 99399 (default app) Apr 16 16:48:54.305291 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: WARNING keystonemiddleware.auth_token [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 16:48:54.311099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: WARNING keystonemiddleware.auth_token [None req-80d1f5d6-4721-46cb-a6c3-9fba1252c367 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 16:48:54.316757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5569013c39c0 pid: 99398 (default app) Apr 16 16:49:36.129116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f405d741-d134-4091-bf30-e05571e2af83 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d465ace18>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:36.425108 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-350582754", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "networks": [{"uuid": "d6379831-b1c8-4a55-8417-e80f9dd885d9"}]}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:49:36.775193 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f405d741-d134-4091-bf30-e05571e2af83 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/8c94d803-3640-417b-a0ef-8c3fdccdd22a" status: 200 len: 351 microversion: 2.1 time: 0.964387 Apr 16 16:49:36.776043 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 1/1] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:49:35 2021] GET /compute/v2.1/os-volumes/8c94d803-3640-417b-a0ef-8c3fdccdd22a => generated 351 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:49:36.950394 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] validate_networks() for [('d6379831-b1c8-4a55-8417-e80f9dd885d9', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:49:38.824232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e536a1a0-9011-4fde-940c-a57aa54abaa1 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d4637a400>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:38.955054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e536a1a0-9011-4fde-940c-a57aa54abaa1 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/690c368c-2306-4a4d-ad15-944081d91af0" status: 200 len: 351 microversion: 2.1 time: 0.137978 Apr 16 16:49:38.955574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 2/2] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:49:38 2021] GET /compute/v2.1/os-volumes/690c368c-2306-4a4d-ad15-944081d91af0 => generated 351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:49:39.425061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:49:39.425657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:49:39.426760 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:49:39.428192 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:49:39.429223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:49:39.479030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:39.497776 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:39.498784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:39.501181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:39.560277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Getting quotas for project 3c4509f4d9074c578fb7a7179ade0427. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:49:39.574811 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Getting quotas for user a019fec4cf854661b1899f9e065946c3 and project 3c4509f4d9074c578fb7a7179ade0427. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:49:39.606124 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:49:39.627765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:49:39.762621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-186f0e38-c925-42de-957f-7d5fee62a7c4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.208993 Apr 16 16:49:39.763801 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 1/3] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:49:35 2021] POST /compute/v2.1/servers => generated 382 bytes in 4212 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:49:39.777190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-453107fc-d021-4c15-813a-ad84952eecf2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:39.779179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-453107fc-d021-4c15-813a-ad84952eecf2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:40.204671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-453107fc-d021-4c15-813a-ad84952eecf2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:40.238659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-453107fc-d021-4c15-813a-ad84952eecf2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1218 microversion: 2.1 time: 0.457590 Apr 16 16:49:40.238659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 3/4] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:39 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1218 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:40.436160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-504852493", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "networks": [{"uuid": "4b2a2bf5-f241-4566-8a43-225171ec9f91"}]}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:49:40.608403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] validate_networks() for [('4b2a2bf5-f241-4566-8a43-225171ec9f91', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:49:40.692583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-222bb2e2-0470-4ee6-9bf0-a5cb7efddca3 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d463ceae8>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:40.876560 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-222bb2e2-0470-4ee6-9bf0-a5cb7efddca3 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/66f01dae-e344-4693-b91b-8ec9343b3257" status: 200 len: 350 microversion: 2.1 time: 0.188578 Apr 16 16:49:40.877302 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 4/5] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:49:40 2021] GET /compute/v2.1/os-volumes/66f01dae-e344-4693-b91b-8ec9343b3257 => generated 350 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:49:40.891037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bf80f8e0-5381-47d3-972b-c67a49e0a7da tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d46406b70>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:41.053530 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bf80f8e0-5381-47d3-972b-c67a49e0a7da tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.167440 Apr 16 16:49:41.054776 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 5/6] 10.222.0.103 () {58 vars in 1129 bytes} [Fri Apr 16 16:49:40 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:41.068640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-75a2eedf-89ae-434c-9d3c-019eec083424 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d46413400>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:41.293193 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-75a2eedf-89ae-434c-9d3c-019eec083424 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.229307 Apr 16 16:49:41.293795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 6/7] 10.222.0.103 () {58 vars in 1144 bytes} [Fri Apr 16 16:49:41 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:49:41.306406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5f08fdaf-0276-45f2-abad-31534010d8d3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:41.308640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5f08fdaf-0276-45f2-abad-31534010d8d3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:41.990421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5f08fdaf-0276-45f2-abad-31534010d8d3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:42.002857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5f08fdaf-0276-45f2-abad-31534010d8d3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1218 microversion: 2.1 time: 0.700437 Apr 16 16:49:42.003964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 7/8] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:41 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1218 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:42.013374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-10e38128-a01e-4bcd-b1e9-a5d8e2c1f66b tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d463ceae8>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:42.247881 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-10e38128-a01e-4bcd-b1e9-a5d8e2c1f66b tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.239854 Apr 16 16:49:42.257444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 8/9] 10.222.0.103 () {58 vars in 1129 bytes} [Fri Apr 16 16:49:42 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:42.270784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-af19b42b-f702-4c77-b436-6cee904fb37e tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d46413bf8>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:42.458058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-af19b42b-f702-4c77-b436-6cee904fb37e tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.193199 Apr 16 16:49:42.459136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 9/10] 10.222.0.103 () {58 vars in 1162 bytes} [Fri Apr 16 16:49:42 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:49:42.472497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d9de0f94-4e09-40cd-8860-5a364bb526b2 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d46413e18>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:42.580541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d9de0f94-4e09-40cd-8860-5a364bb526b2 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.111866 Apr 16 16:49:42.581829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 10/11] 10.222.0.103 () {58 vars in 1165 bytes} [Fri Apr 16 16:49:42 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:49:42.595945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dcdc0730-d72f-401d-b041-e735745aed80 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d464131e0>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:42.800386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dcdc0730-d72f-401d-b041-e735745aed80 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.206584 Apr 16 16:49:42.800386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 11/12] 10.222.0.103 () {58 vars in 1150 bytes} [Fri Apr 16 16:49:42 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:42.811816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b3655897-fd14-4b80-804f-7830b7fbc144 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d46406c80>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:43.073180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b3655897-fd14-4b80-804f-7830b7fbc144 tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.265345 Apr 16 16:49:43.073805 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 12/13] 10.222.0.103 () {58 vars in 1183 bytes} [Fri Apr 16 16:49:42 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:49:43.087294 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ab8c73ec-9dce-4fee-b2bc-29a5c2d3e32f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:43.088944 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ab8c73ec-9dce-4fee-b2bc-29a5c2d3e32f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:43.106154 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ab8c73ec-9dce-4fee-b2bc-29a5c2d3e32f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:43.124733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ab8c73ec-9dce-4fee-b2bc-29a5c2d3e32f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:43.126085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ab8c73ec-9dce-4fee-b2bc-29a5c2d3e32f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:43.128930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ab8c73ec-9dce-4fee-b2bc-29a5c2d3e32f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:43.603671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ab8c73ec-9dce-4fee-b2bc-29a5c2d3e32f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:43.623859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ab8c73ec-9dce-4fee-b2bc-29a5c2d3e32f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1276 microversion: 2.1 time: 0.548623 Apr 16 16:49:43.628182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 13/14] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:43 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1276 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:43.643770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ebe96b03-9b18-4a6e-82c7-2a60e9bed6de tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] Calling method '.version_select at 0x7f0d462d76a8>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:43.868863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ebe96b03-9b18-4a6e-82c7-2a60e9bed6de tempest-VolumesTestJSON-127724278 tempest-VolumesTestJSON-127724278-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.238054 Apr 16 16:49:43.869900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 14/15] 10.222.0.103 () {58 vars in 1150 bytes} [Fri Apr 16 16:49:43 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:44.649607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-20004dbf-477c-4281-97c1-9aa37de8f326 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:44.656190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-20004dbf-477c-4281-97c1-9aa37de8f326 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:44.680708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20004dbf-477c-4281-97c1-9aa37de8f326 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:44.682847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20004dbf-477c-4281-97c1-9aa37de8f326 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:44.683939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20004dbf-477c-4281-97c1-9aa37de8f326 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:44.686246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20004dbf-477c-4281-97c1-9aa37de8f326 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:44.943013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:49:44.943911 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:49:44.944419 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:49:44.944868 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:49:44.945321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:49:44.961780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:44.962276 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:44.966382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:44.966920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:45.023833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Getting quotas for project a46c79620899432c8193a987ece333df. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:49:45.063659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Getting quotas for user 44a48edfa5ca47949ffb787b0d7fe204 and project a46c79620899432c8193a987ece333df. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:49:45.104737 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:49:45.120241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:49:45.289644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-75bef3e6-a25f-4a4b-b8bd-c875785f5880 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 5.043936 Apr 16 16:49:45.299370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 2/16] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:49:40 2021] POST /compute/v2.1/servers => generated 382 bytes in 5054 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:49:45.310905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fa7d89f3-c7f2-46d6-83d2-350cca5a0a2f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:45.312159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fa7d89f3-c7f2-46d6-83d2-350cca5a0a2f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:45.336542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-20004dbf-477c-4281-97c1-9aa37de8f326 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:45.352574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-20004dbf-477c-4281-97c1-9aa37de8f326 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1276 microversion: 2.1 time: 0.709066 Apr 16 16:49:45.369306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 15/17] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:44 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1276 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:49:45.870153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fa7d89f3-c7f2-46d6-83d2-350cca5a0a2f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:45.898431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fa7d89f3-c7f2-46d6-83d2-350cca5a0a2f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1221 microversion: 2.1 time: 0.592675 Apr 16 16:49:45.911326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 3/18] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:45 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1221 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:46.387237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-23aaabd6-6065-4c06-aa50-e90b4b1e6027 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:46.388500 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-23aaabd6-6065-4c06-aa50-e90b4b1e6027 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:46.417719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-23aaabd6-6065-4c06-aa50-e90b4b1e6027 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:46.418636 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-23aaabd6-6065-4c06-aa50-e90b4b1e6027 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:46.423150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-23aaabd6-6065-4c06-aa50-e90b4b1e6027 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:46.427871 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-23aaabd6-6065-4c06-aa50-e90b4b1e6027 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:46.930108 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-55ac3732-2e6b-44a2-8535-2d0f2558b604 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:46.930878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-55ac3732-2e6b-44a2-8535-2d0f2558b604 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:46.976141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-23aaabd6-6065-4c06-aa50-e90b4b1e6027 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:47.011057 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-23aaabd6-6065-4c06-aa50-e90b4b1e6027 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1276 microversion: 2.1 time: 0.605022 Apr 16 16:49:47.012449 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 16/19] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:46 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1276 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:47.552020 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-55ac3732-2e6b-44a2-8535-2d0f2558b604 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:47.591880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-55ac3732-2e6b-44a2-8535-2d0f2558b604 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1221 microversion: 2.1 time: 0.666948 Apr 16 16:49:47.616261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 4/20] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:46 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1221 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:49:48.048535 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c2bc276c-79e1-402e-b430-3476c1590ae9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:48.050541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c2bc276c-79e1-402e-b430-3476c1590ae9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:48.107193 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2bc276c-79e1-402e-b430-3476c1590ae9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:48.107979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2bc276c-79e1-402e-b430-3476c1590ae9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:48.111665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2bc276c-79e1-402e-b430-3476c1590ae9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:48.113373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2bc276c-79e1-402e-b430-3476c1590ae9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:48.625839 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d3327c4d-eb35-4409-bd80-246f18ca6665 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:48.627857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d3327c4d-eb35-4409-bd80-246f18ca6665 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:48.671101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3327c4d-eb35-4409-bd80-246f18ca6665 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:48.685577 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3327c4d-eb35-4409-bd80-246f18ca6665 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:48.688849 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3327c4d-eb35-4409-bd80-246f18ca6665 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:48.693435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3327c4d-eb35-4409-bd80-246f18ca6665 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:48.843006 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c2bc276c-79e1-402e-b430-3476c1590ae9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:48.860696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c2bc276c-79e1-402e-b430-3476c1590ae9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1276 microversion: 2.1 time: 0.826874 Apr 16 16:49:48.861339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 17/21] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:48 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1276 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:49.880179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-74ceb8f6-425a-4a34-a2e1-fee1606962c6 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:49.881841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-74ceb8f6-425a-4a34-a2e1-fee1606962c6 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:49.919977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74ceb8f6-425a-4a34-a2e1-fee1606962c6 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:49.929882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74ceb8f6-425a-4a34-a2e1-fee1606962c6 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:49.937904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74ceb8f6-425a-4a34-a2e1-fee1606962c6 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:49.947685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74ceb8f6-425a-4a34-a2e1-fee1606962c6 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:50.249744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d3327c4d-eb35-4409-bd80-246f18ca6665 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:50.288927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d3327c4d-eb35-4409-bd80-246f18ca6665 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1217 microversion: 2.1 time: 1.661472 Apr 16 16:49:50.295268 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 5/22] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:48 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1217 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:49:50.535855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-74ceb8f6-425a-4a34-a2e1-fee1606962c6 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:50.557465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-74ceb8f6-425a-4a34-a2e1-fee1606962c6 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1276 microversion: 2.1 time: 0.681766 Apr 16 16:49:50.558105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 18/23] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:49 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1276 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:49:51.313402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6b1ff6ea-7b5e-463e-a07c-0ae2eb7424ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:51.314536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6b1ff6ea-7b5e-463e-a07c-0ae2eb7424ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:51.329991 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6b1ff6ea-7b5e-463e-a07c-0ae2eb7424ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:51.330525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6b1ff6ea-7b5e-463e-a07c-0ae2eb7424ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:51.331347 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6b1ff6ea-7b5e-463e-a07c-0ae2eb7424ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:51.347914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6b1ff6ea-7b5e-463e-a07c-0ae2eb7424ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:51.903162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7bf05c1f-e777-4ddc-b926-d676856147a2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'create', calling method: .version_select at 0x7f0d46413bf8>, body: {"keypair": {"name": "tempest-keypair-2041989043"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:49:52.043545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-7bf05c1f-e777-4ddc-b926-d676856147a2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for project fb882053c8e84304847e19528f11d911. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:49:52.049072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-7bf05c1f-e777-4ddc-b926-d676856147a2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for user f60265b8ee174e36a604896147c47d60 and project fb882053c8e84304847e19528f11d911. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:49:52.638026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-7bf05c1f-e777-4ddc-b926-d676856147a2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for project fb882053c8e84304847e19528f11d911. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:49:52.649483 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-7bf05c1f-e777-4ddc-b926-d676856147a2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for user f60265b8ee174e36a604896147c47d60 and project fb882053c8e84304847e19528f11d911. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:49:52.687464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7bf05c1f-e777-4ddc-b926-d676856147a2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.224600 Apr 16 16:49:52.690398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 19/24] 10.222.0.103 () {62 vars in 1194 bytes} [Fri Apr 16 16:49:51 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1228 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 16 16:49:52.696474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b211e121-4d0c-44ad-abe4-c00be159d9e0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:52.697469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b211e121-4d0c-44ad-abe4-c00be159d9e0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:52.714381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b211e121-4d0c-44ad-abe4-c00be159d9e0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:52.719332 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b211e121-4d0c-44ad-abe4-c00be159d9e0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:52.730271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b211e121-4d0c-44ad-abe4-c00be159d9e0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:52.735598 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b211e121-4d0c-44ad-abe4-c00be159d9e0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:53.616277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b211e121-4d0c-44ad-abe4-c00be159d9e0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:53.642200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b211e121-4d0c-44ad-abe4-c00be159d9e0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1276 microversion: 2.1 time: 0.950264 Apr 16 16:49:53.643425 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 20/25] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:52 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1276 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:54.667360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ded57a95-4851-489d-b71d-c51812714de4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:54.668373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ded57a95-4851-489d-b71d-c51812714de4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:54.712480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ded57a95-4851-489d-b71d-c51812714de4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:54.712997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ded57a95-4851-489d-b71d-c51812714de4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:54.714295 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ded57a95-4851-489d-b71d-c51812714de4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:54.714947 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ded57a95-4851-489d-b71d-c51812714de4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:58.404584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6b1ff6ea-7b5e-463e-a07c-0ae2eb7424ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:58.423254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6b1ff6ea-7b5e-463e-a07c-0ae2eb7424ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1321 microversion: 2.1 time: 7.114018 Apr 16 16:49:58.430149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 6/26] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:51 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1321 bytes in 7122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:59.447789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e9279522-cb93-41dd-a92b-f951ee1480a2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:49:59.449143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e9279522-cb93-41dd-a92b-f951ee1480a2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:49:59.457726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9279522-cb93-41dd-a92b-f951ee1480a2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:59.459203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9279522-cb93-41dd-a92b-f951ee1480a2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:59.460354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9279522-cb93-41dd-a92b-f951ee1480a2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:59.461124 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9279522-cb93-41dd-a92b-f951ee1480a2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:59.544271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ded57a95-4851-489d-b71d-c51812714de4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:49:59.555000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ded57a95-4851-489d-b71d-c51812714de4 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 4.891670 Apr 16 16:49:59.556018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 21/27] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:54 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 4893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:49:59.667659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-384877ce-686a-4cc9-a2ee-54f294d7ce7d req-bd3f81ac-eddb-40fe-8b24-f8c3fd574499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce1414be-e673-4c5e-b491-990d5eabe83f", "tag": "baf1bfe7-da12-4d36-b1c7-35557ebac6d2"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:49:59.670194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:49:59.670194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:49:59.680011 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-384877ce-686a-4cc9-a2ee-54f294d7ce7d req-bd3f81ac-eddb-40fe-8b24-f8c3fd574499 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:59.680855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-384877ce-686a-4cc9-a2ee-54f294d7ce7d req-bd3f81ac-eddb-40fe-8b24-f8c3fd574499 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:59.704018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-384877ce-686a-4cc9-a2ee-54f294d7ce7d req-bd3f81ac-eddb-40fe-8b24-f8c3fd574499 service nova] Creating event network-changed:baf1bfe7-da12-4d36-b1c7-35557ebac6d2 for instance ce1414be-e673-4c5e-b491-990d5eabe83f on hv-cinder-73362 Apr 16 16:49:59.704769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-384877ce-686a-4cc9-a2ee-54f294d7ce7d req-bd3f81ac-eddb-40fe-8b24-f8c3fd574499 service nova] Acquired lock "compute-rpcapi-router" {{(pid=99398) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 16 16:49:59.706128 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-458acf44-88a0-4dfd-8e51-e248ffb3b099 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:59.706803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-458acf44-88a0-4dfd-8e51-e248ffb3b099 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:59.707989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-458acf44-88a0-4dfd-8e51-e248ffb3b099 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:49:59.708820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-458acf44-88a0-4dfd-8e51-e248ffb3b099 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:49:59.719197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.compute.rpcapi [None req-458acf44-88a0-4dfd-8e51-e248ffb3b099 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 16 16:49:59.721896 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-458acf44-88a0-4dfd-8e51-e248ffb3b099 None None] Releasing lock "compute-rpcapi-router" {{(pid=99398) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 16 16:49:59.776844 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-458acf44-88a0-4dfd-8e51-e248ffb3b099 None None] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185869 Apr 16 16:49:59.778311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 22/28] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:49:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:00.576525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-21a521fa-a5be-4b5c-b294-354f27de79b2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:00.582469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-21a521fa-a5be-4b5c-b294-354f27de79b2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:00.603308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21a521fa-a5be-4b5c-b294-354f27de79b2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:00.605512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21a521fa-a5be-4b5c-b294-354f27de79b2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:00.609037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21a521fa-a5be-4b5c-b294-354f27de79b2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:00.609552 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21a521fa-a5be-4b5c-b294-354f27de79b2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:01.442416 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e9279522-cb93-41dd-a92b-f951ee1480a2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:01.476732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e9279522-cb93-41dd-a92b-f951ee1480a2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1321 microversion: 2.1 time: 2.032737 Apr 16 16:50:01.478101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 7/29] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:49:59 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1321 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:01.553647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-21a521fa-a5be-4b5c-b294-354f27de79b2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:01.566878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-21a521fa-a5be-4b5c-b294-354f27de79b2 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 0.995487 Apr 16 16:50:01.581777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 23/30] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:00 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:01.597065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-886562441", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5636c544-b076-4465-9c13-a664e37a5e03"}], "security_groups": [{"name": "tempest-securitygroup--205742978"}], "key_name": "tempest-keypair-2041989043", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:02.000448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1374616099", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "880a3b9d-09cf-48d2-b88b-bd1b126573cb"}]}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:02.151238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] validate_networks() for [('880a3b9d-09cf-48d2-b88b-bd1b126573cb', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:50:02.866875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] validate_networks() for [('5636c544-b076-4465-9c13-a664e37a5e03', None, None, None)] {{(pid=99398) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:50:06.128746 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:50:06.129361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:50:06.129729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:50:06.131273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:50:06.132128 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:50:06.143591 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:06.144105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:06.144982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:06.145477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:06.184184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Getting quotas for project cf1487baf5ab430cb361532e11cd888c. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:50:06.193260 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Getting quotas for user dfd10c1162d24f85acdbe3fe3d55a36e and project cf1487baf5ab430cb361532e11cd888c. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:50:06.205972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:50:06.209421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:50:06.342521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6ebdff3d-31fa-40b9-8885-731c5ddcc34f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.862943 Apr 16 16:50:06.343494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 8/31] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:50:01 2021] POST /compute/v2.1/servers => generated 385 bytes in 4865 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:50:06.367804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2ad814f3-97f3-40a2-b081-12f3b9b0293b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:06.368894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2ad814f3-97f3-40a2-b081-12f3b9b0293b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:06.378726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2ad814f3-97f3-40a2-b081-12f3b9b0293b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:06.379118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2ad814f3-97f3-40a2-b081-12f3b9b0293b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:06.380617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2ad814f3-97f3-40a2-b081-12f3b9b0293b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:06.381923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2ad814f3-97f3-40a2-b081-12f3b9b0293b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:08.327279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2ad814f3-97f3-40a2-b081-12f3b9b0293b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:08.375237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2ad814f3-97f3-40a2-b081-12f3b9b0293b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1321 microversion: 2.1 time: 2.011679 Apr 16 16:50:08.376186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 9/32] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:06 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1321 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:08.389442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f122e602-5c44-4c63-9572-bcbffd8ace29 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:08.390136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f122e602-5c44-4c63-9572-bcbffd8ace29 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:08.418968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f122e602-5c44-4c63-9572-bcbffd8ace29 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:08.419490 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f122e602-5c44-4c63-9572-bcbffd8ace29 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:08.420332 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f122e602-5c44-4c63-9572-bcbffd8ace29 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:08.420832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f122e602-5c44-4c63-9572-bcbffd8ace29 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:08.924061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Flavor limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:50:08.924640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Image limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:50:08.925289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Flavor pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:50:08.925976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Image pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:50:08.926859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:50:08.952971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:08.953694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:08.954821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:08.955596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:08.999785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for project fb882053c8e84304847e19528f11d911. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:50:09.012106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for user f60265b8ee174e36a604896147c47d60 and project fb882053c8e84304847e19528f11d911. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:50:09.053562 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Going to run 1 instances... {{(pid=99398) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:50:09.062098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:50:09.235499 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-14a2194f-dea1-44a7-bcb4-f08ec499ef13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 7.648654 Apr 16 16:50:09.236209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 24/33] 10.222.0.103 () {62 vars in 1183 bytes} [Fri Apr 16 16:50:01 2021] POST /compute/v2.1/servers => generated 403 bytes in 7653 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 16 16:50:09.248680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f03efcea-37ec-410c-b786-7c1f574bff42 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:09.264096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f03efcea-37ec-410c-b786-7c1f574bff42 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:09.297533 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f03efcea-37ec-410c-b786-7c1f574bff42 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:09.301361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f03efcea-37ec-410c-b786-7c1f574bff42 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:09.305935 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f03efcea-37ec-410c-b786-7c1f574bff42 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:09.306484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f03efcea-37ec-410c-b786-7c1f574bff42 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:09.774833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f03efcea-37ec-410c-b786-7c1f574bff42 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:09.791997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f03efcea-37ec-410c-b786-7c1f574bff42 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1284 microversion: 2.1 time: 0.547903 Apr 16 16:50:09.792637 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 25/34] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:09 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1284 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:10.213442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f122e602-5c44-4c63-9572-bcbffd8ace29 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:10.227686 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-613b85e3-cbfc-4ec1-bccd-8adc6f185e62 req-00049f28-4956-40d3-b2c7-4d6a6c2506ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c9b9dd-948e-40a5-aa29-744166975b41", "tag": "0b5e633d-5dc8-49f9-9b83-70c95f998fa9"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:10.229845 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:10.229845 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:10.257733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-613b85e3-cbfc-4ec1-bccd-8adc6f185e62 req-00049f28-4956-40d3-b2c7-4d6a6c2506ec service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:10.262824 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-613b85e3-cbfc-4ec1-bccd-8adc6f185e62 req-00049f28-4956-40d3-b2c7-4d6a6c2506ec service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:10.278450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f122e602-5c44-4c63-9572-bcbffd8ace29 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 1.887779 Apr 16 16:50:10.288166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 10/35] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:08 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:10.308090 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-098bafbe-4b5b-441c-b349-c6b73ccff692 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:10.309332 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-098bafbe-4b5b-441c-b349-c6b73ccff692 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:10.320839 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-098bafbe-4b5b-441c-b349-c6b73ccff692 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:10.321872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-613b85e3-cbfc-4ec1-bccd-8adc6f185e62 req-00049f28-4956-40d3-b2c7-4d6a6c2506ec service nova] Creating event network-changed:0b5e633d-5dc8-49f9-9b83-70c95f998fa9 for instance 85c9b9dd-948e-40a5-aa29-744166975b41 on hv-cinder-73362 Apr 16 16:50:10.322800 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-098bafbe-4b5b-441c-b349-c6b73ccff692 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:10.323845 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-098bafbe-4b5b-441c-b349-c6b73ccff692 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:10.324518 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-098bafbe-4b5b-441c-b349-c6b73ccff692 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:10.333914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-613b85e3-cbfc-4ec1-bccd-8adc6f185e62 req-00049f28-4956-40d3-b2c7-4d6a6c2506ec service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.539493 Apr 16 16:50:10.337802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 26/36] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:10.347017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c044e480-88e8-4291-98a4-c2133d9b0f5d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:10.347967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c044e480-88e8-4291-98a4-c2133d9b0f5d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:10.371420 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c044e480-88e8-4291-98a4-c2133d9b0f5d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:10.371930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c044e480-88e8-4291-98a4-c2133d9b0f5d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:10.372780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c044e480-88e8-4291-98a4-c2133d9b0f5d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:10.373262 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c044e480-88e8-4291-98a4-c2133d9b0f5d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:10.598418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-098bafbe-4b5b-441c-b349-c6b73ccff692 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:10.618194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-098bafbe-4b5b-441c-b349-c6b73ccff692 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:10.620188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-098bafbe-4b5b-441c-b349-c6b73ccff692 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:10.621574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-098bafbe-4b5b-441c-b349-c6b73ccff692 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1289 microversion: 2.20 time: 0.332204 Apr 16 16:50:10.622414 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 11/37] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:10 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1289 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:10.632009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-151569312", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "880a3b9d-09cf-48d2-b88b-bd1b126573cb"}]}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:10.722075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] validate_networks() for [('880a3b9d-09cf-48d2-b88b-bd1b126573cb', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:50:11.080261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c044e480-88e8-4291-98a4-c2133d9b0f5d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:11.090059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c044e480-88e8-4291-98a4-c2133d9b0f5d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1321 microversion: 2.1 time: 0.750927 Apr 16 16:50:11.094742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 27/38] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:10 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1321 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:11.158248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-246710fd-f518-41c4-8b56-ef840a16d27d req-ddb9184b-af65-46ec-99f7-2f3d8dddafe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1414be-e673-4c5e-b491-990d5eabe83f", "name": "network-vif-plugged", "status": "completed", "tag": "baf1bfe7-da12-4d36-b1c7-35557ebac6d2"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:11.160229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:11.160229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:11.170044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-246710fd-f518-41c4-8b56-ef840a16d27d req-ddb9184b-af65-46ec-99f7-2f3d8dddafe8 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:11.170597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-246710fd-f518-41c4-8b56-ef840a16d27d req-ddb9184b-af65-46ec-99f7-2f3d8dddafe8 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:11.191654 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-246710fd-f518-41c4-8b56-ef840a16d27d req-ddb9184b-af65-46ec-99f7-2f3d8dddafe8 service nova] Creating event network-vif-plugged:baf1bfe7-da12-4d36-b1c7-35557ebac6d2 for instance ce1414be-e673-4c5e-b491-990d5eabe83f on hv-cinder-73362 Apr 16 16:50:11.198255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-246710fd-f518-41c4-8b56-ef840a16d27d req-ddb9184b-af65-46ec-99f7-2f3d8dddafe8 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101404 Apr 16 16:50:11.198870 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 28/39] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:11.303087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bc5b963e-b162-41b8-8349-39d72d6d8e3d tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:11.304789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bc5b963e-b162-41b8-8349-39d72d6d8e3d tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:11.313077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bc5b963e-b162-41b8-8349-39d72d6d8e3d tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:11.313600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bc5b963e-b162-41b8-8349-39d72d6d8e3d tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:11.314570 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bc5b963e-b162-41b8-8349-39d72d6d8e3d tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:11.314947 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bc5b963e-b162-41b8-8349-39d72d6d8e3d tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:12.024216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bc5b963e-b162-41b8-8349-39d72d6d8e3d tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:12.033629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bc5b963e-b162-41b8-8349-39d72d6d8e3d tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 0.736596 Apr 16 16:50:12.034573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 29/40] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:11 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:12.051713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-74937c60-94a3-4828-ad51-70d49f01f4ed tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:12.053569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-74937c60-94a3-4828-ad51-70d49f01f4ed tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:12.062912 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74937c60-94a3-4828-ad51-70d49f01f4ed tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:12.063660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74937c60-94a3-4828-ad51-70d49f01f4ed tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:12.065155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74937c60-94a3-4828-ad51-70d49f01f4ed tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:12.065931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74937c60-94a3-4828-ad51-70d49f01f4ed tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:12.429076 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-74937c60-94a3-4828-ad51-70d49f01f4ed tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:12.441368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-74937c60-94a3-4828-ad51-70d49f01f4ed tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:12.443612 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-74937c60-94a3-4828-ad51-70d49f01f4ed tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:12.445179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-74937c60-94a3-4828-ad51-70d49f01f4ed tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1337 microversion: 2.20 time: 0.409357 Apr 16 16:50:12.457104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 30/41] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:12 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1337 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:12.470253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fd9e4269-fbc0-40b5-a599-ef94aef3b31a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:12.470971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fd9e4269-fbc0-40b5-a599-ef94aef3b31a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:12.481395 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd9e4269-fbc0-40b5-a599-ef94aef3b31a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:12.482757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd9e4269-fbc0-40b5-a599-ef94aef3b31a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:12.483872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd9e4269-fbc0-40b5-a599-ef94aef3b31a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:12.484592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd9e4269-fbc0-40b5-a599-ef94aef3b31a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:12.581939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:50:12.582722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:50:12.583480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:50:12.584098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:50:12.584661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:50:12.594434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:12.595324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:12.596404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:12.597092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:12.620593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Getting quotas for project cf1487baf5ab430cb361532e11cd888c. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:50:12.625316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Getting quotas for user dfd10c1162d24f85acdbe3fe3d55a36e and project cf1487baf5ab430cb361532e11cd888c. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:50:12.638373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:50:12.641393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:50:12.704320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-be0f9747-90d6-44f5-8d03-17d8bd0ba75c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.080587 Apr 16 16:50:12.705749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 12/42] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:50:10 2021] POST /compute/v2.1/servers => generated 385 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:50:12.716601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c71fc21d-79a3-43b9-b816-56d2d58055c0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:12.717443 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c71fc21d-79a3-43b9-b816-56d2d58055c0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:12.930435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c71fc21d-79a3-43b9-b816-56d2d58055c0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:12.943712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c71fc21d-79a3-43b9-b816-56d2d58055c0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1225 microversion: 2.1 time: 0.230616 Apr 16 16:50:12.945297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 13/43] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:12 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1225 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:13.064907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5b285591-4d38-40aa-bad9-13f7e9627f52 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:13.067105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5b285591-4d38-40aa-bad9-13f7e9627f52 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:13.091619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b285591-4d38-40aa-bad9-13f7e9627f52 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:13.092200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b285591-4d38-40aa-bad9-13f7e9627f52 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:13.093121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b285591-4d38-40aa-bad9-13f7e9627f52 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:13.093678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b285591-4d38-40aa-bad9-13f7e9627f52 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:13.311584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fd9e4269-fbc0-40b5-a599-ef94aef3b31a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:13.321202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fd9e4269-fbc0-40b5-a599-ef94aef3b31a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1321 microversion: 2.1 time: 0.862654 Apr 16 16:50:13.321849 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 31/44] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:12 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1321 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:13.482063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-03962b6a-1a4d-42bd-bae9-e3156ba78579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:13.483466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-03962b6a-1a4d-42bd-bae9-e3156ba78579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:13.492778 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03962b6a-1a4d-42bd-bae9-e3156ba78579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:13.493611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03962b6a-1a4d-42bd-bae9-e3156ba78579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:13.494691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03962b6a-1a4d-42bd-bae9-e3156ba78579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:13.495319 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03962b6a-1a4d-42bd-bae9-e3156ba78579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:13.531110 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5b285591-4d38-40aa-bad9-13f7e9627f52 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:13.546328 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5b285591-4d38-40aa-bad9-13f7e9627f52 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 0.493005 Apr 16 16:50:13.547115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 14/45] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:13 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:13.833888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-03962b6a-1a4d-42bd-bae9-e3156ba78579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:13.863683 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-03962b6a-1a4d-42bd-bae9-e3156ba78579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:13.871647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-03962b6a-1a4d-42bd-bae9-e3156ba78579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:13.873000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-03962b6a-1a4d-42bd-bae9-e3156ba78579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1337 microversion: 2.20 time: 0.411524 Apr 16 16:50:13.884855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 32/46] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:13 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1337 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:13.963806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a418a0a6-366f-4127-903c-c854afffc281 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:13.964615 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a418a0a6-366f-4127-903c-c854afffc281 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:13.979418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a418a0a6-366f-4127-903c-c854afffc281 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:13.980165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a418a0a6-366f-4127-903c-c854afffc281 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:13.987662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a418a0a6-366f-4127-903c-c854afffc281 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:13.988665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a418a0a6-366f-4127-903c-c854afffc281 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:14.112494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8a43568d-c61a-405c-8b53-a189ebb64871 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'create', calling method: .version_select at 0x7f0d4640cae8>, body: {"keypair": {"name": "tempest-keypair-1322091839"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:14.163655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-8a43568d-c61a-405c-8b53-a189ebb64871 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for project 26fb0e15979d43999b94901003579a6a. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:50:14.168036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-8a43568d-c61a-405c-8b53-a189ebb64871 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for user c2e7f3d7b43748658c69c338db617181 and project 26fb0e15979d43999b94901003579a6a. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:50:14.506776 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a418a0a6-366f-4127-903c-c854afffc281 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:14.534754 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a418a0a6-366f-4127-903c-c854afffc281 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1277 microversion: 2.1 time: 0.575647 Apr 16 16:50:14.541203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 33/47] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:13 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1277 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:14.556690 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-515cdb85-4a9d-4cc0-9747-287497600d3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:14.571550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-515cdb85-4a9d-4cc0-9747-287497600d3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:14.604505 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-515cdb85-4a9d-4cc0-9747-287497600d3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:14.605029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-515cdb85-4a9d-4cc0-9747-287497600d3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:14.610635 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-515cdb85-4a9d-4cc0-9747-287497600d3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:14.611678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-515cdb85-4a9d-4cc0-9747-287497600d3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:15.158717 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-8a43568d-c61a-405c-8b53-a189ebb64871 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for project 26fb0e15979d43999b94901003579a6a. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:50:15.169914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-8a43568d-c61a-405c-8b53-a189ebb64871 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for user c2e7f3d7b43748658c69c338db617181 and project 26fb0e15979d43999b94901003579a6a. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:50:15.207070 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8a43568d-c61a-405c-8b53-a189ebb64871 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.414110 Apr 16 16:50:15.208507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 15/48] 10.222.0.103 () {60 vars in 1153 bytes} [Fri Apr 16 16:50:13 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:15.213722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b24b3cac-33f2-47f8-8d11-cdfc3677f976 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:15.217325 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b24b3cac-33f2-47f8-8d11-cdfc3677f976 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:15.236776 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b24b3cac-33f2-47f8-8d11-cdfc3677f976 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:15.237644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b24b3cac-33f2-47f8-8d11-cdfc3677f976 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:15.240561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b24b3cac-33f2-47f8-8d11-cdfc3677f976 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:15.241756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b24b3cac-33f2-47f8-8d11-cdfc3677f976 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:16.402020 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-515cdb85-4a9d-4cc0-9747-287497600d3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:16.413536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-515cdb85-4a9d-4cc0-9747-287497600d3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1321 microversion: 2.1 time: 1.870084 Apr 16 16:50:16.418579 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 34/49] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:14 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1321 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:16.426984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d6cf3254-7636-4b64-b934-020bafd7dbc6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:16.435482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d6cf3254-7636-4b64-b934-020bafd7dbc6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:16.457084 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d6cf3254-7636-4b64-b934-020bafd7dbc6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:16.457830 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d6cf3254-7636-4b64-b934-020bafd7dbc6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:16.459184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d6cf3254-7636-4b64-b934-020bafd7dbc6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:16.459972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d6cf3254-7636-4b64-b934-020bafd7dbc6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:16.633788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b24b3cac-33f2-47f8-8d11-cdfc3677f976 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:16.647322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b24b3cac-33f2-47f8-8d11-cdfc3677f976 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 1.437264 Apr 16 16:50:16.651239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 16/50] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:15 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:16.669058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3560b417-d1a5-4305-8096-ff4deaa5ff60 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:16.670240 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3560b417-d1a5-4305-8096-ff4deaa5ff60 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:16.699582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3560b417-d1a5-4305-8096-ff4deaa5ff60 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:16.700126 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3560b417-d1a5-4305-8096-ff4deaa5ff60 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:16.702000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3560b417-d1a5-4305-8096-ff4deaa5ff60 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:16.705143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3560b417-d1a5-4305-8096-ff4deaa5ff60 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:17.004462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d6cf3254-7636-4b64-b934-020bafd7dbc6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:17.023843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d6cf3254-7636-4b64-b934-020bafd7dbc6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:17.025549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d6cf3254-7636-4b64-b934-020bafd7dbc6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:17.026779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d6cf3254-7636-4b64-b934-020bafd7dbc6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1343 microversion: 2.20 time: 0.606979 Apr 16 16:50:17.027381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 35/51] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:16 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1343 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:17.040220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3560b417-d1a5-4305-8096-ff4deaa5ff60 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:17.054190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3560b417-d1a5-4305-8096-ff4deaa5ff60 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1283 microversion: 2.1 time: 0.397978 Apr 16 16:50:17.060206 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 17/52] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:16 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1283 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:17.436677 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fac27335-2953-4751-ba72-25cf96678792 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:17.438084 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fac27335-2953-4751-ba72-25cf96678792 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:17.455131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fac27335-2953-4751-ba72-25cf96678792 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:17.455656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fac27335-2953-4751-ba72-25cf96678792 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:17.456535 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fac27335-2953-4751-ba72-25cf96678792 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:17.457035 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fac27335-2953-4751-ba72-25cf96678792 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:17.668806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-df992c33-ff1e-4a92-9c36-6c23f0bf0f3e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:17.669472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-df992c33-ff1e-4a92-9c36-6c23f0bf0f3e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:17.682088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-df992c33-ff1e-4a92-9c36-6c23f0bf0f3e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:17.685306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-df992c33-ff1e-4a92-9c36-6c23f0bf0f3e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:17.686418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-df992c33-ff1e-4a92-9c36-6c23f0bf0f3e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:17.687078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-df992c33-ff1e-4a92-9c36-6c23f0bf0f3e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:17.985290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fac27335-2953-4751-ba72-25cf96678792 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:17.995551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fac27335-2953-4751-ba72-25cf96678792 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1321 microversion: 2.1 time: 0.563114 Apr 16 16:50:18.006908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 36/53] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:17 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1321 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:18.052025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-955ca11c-16df-4374-9ab5-0d7a45a24bc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:18.053049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-955ca11c-16df-4374-9ab5-0d7a45a24bc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:18.071402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-955ca11c-16df-4374-9ab5-0d7a45a24bc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:18.072198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-955ca11c-16df-4374-9ab5-0d7a45a24bc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:18.073217 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-955ca11c-16df-4374-9ab5-0d7a45a24bc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:18.073845 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-955ca11c-16df-4374-9ab5-0d7a45a24bc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:18.399272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-df992c33-ff1e-4a92-9c36-6c23f0bf0f3e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:18.410452 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-df992c33-ff1e-4a92-9c36-6c23f0bf0f3e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 0.745517 Apr 16 16:50:18.411694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 18/54] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:17 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:18.431072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3a609861-4e7b-4325-9492-5b254dd53df3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:18.432295 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3a609861-4e7b-4325-9492-5b254dd53df3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:18.440760 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a609861-4e7b-4325-9492-5b254dd53df3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:18.441907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a609861-4e7b-4325-9492-5b254dd53df3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:18.443967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a609861-4e7b-4325-9492-5b254dd53df3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:18.444549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a609861-4e7b-4325-9492-5b254dd53df3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:18.831458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-955ca11c-16df-4374-9ab5-0d7a45a24bc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:18.843733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-955ca11c-16df-4374-9ab5-0d7a45a24bc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:18.845548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-955ca11c-16df-4374-9ab5-0d7a45a24bc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:18.846993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-955ca11c-16df-4374-9ab5-0d7a45a24bc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.799652 Apr 16 16:50:18.858327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 37/55] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:18 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:50:18.858327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-ded6f44e-cf35-449f-8203-56ecdbd0d1fc req-f6b63819-85a7-4da9-9f18-cf215aa39fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "139562a9-bb46-4937-898d-cf6179ddc48d", "tag": "225036d6-cc14-48bb-962c-c75655bf76af"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:18.858327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:18.858327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:18.869430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-ded6f44e-cf35-449f-8203-56ecdbd0d1fc req-f6b63819-85a7-4da9-9f18-cf215aa39fe9 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:18.869945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-ded6f44e-cf35-449f-8203-56ecdbd0d1fc req-f6b63819-85a7-4da9-9f18-cf215aa39fe9 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:18.888607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-ded6f44e-cf35-449f-8203-56ecdbd0d1fc req-f6b63819-85a7-4da9-9f18-cf215aa39fe9 service nova] Creating event network-changed:225036d6-cc14-48bb-962c-c75655bf76af for instance 139562a9-bb46-4937-898d-cf6179ddc48d on hv-cinder-73362 Apr 16 16:50:18.900749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-ded6f44e-cf35-449f-8203-56ecdbd0d1fc req-f6b63819-85a7-4da9-9f18-cf215aa39fe9 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049422 Apr 16 16:50:18.901563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 38/56] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:18.925770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3a609861-4e7b-4325-9492-5b254dd53df3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:18.935373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3a609861-4e7b-4325-9492-5b254dd53df3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.511505 Apr 16 16:50:18.936361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 19/57] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:18 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:19.015676 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-16568b70-7245-4787-bbd8-d8cb241f81de tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:19.016455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-16568b70-7245-4787-bbd8-d8cb241f81de tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:19.046228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-16568b70-7245-4787-bbd8-d8cb241f81de tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:19.046984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-16568b70-7245-4787-bbd8-d8cb241f81de tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:19.047903 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-16568b70-7245-4787-bbd8-d8cb241f81de tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:19.048401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-16568b70-7245-4787-bbd8-d8cb241f81de tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:19.290409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-16568b70-7245-4787-bbd8-d8cb241f81de tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:19.302661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-16568b70-7245-4787-bbd8-d8cb241f81de tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1321 microversion: 2.1 time: 0.291225 Apr 16 16:50:19.303540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 39/58] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:19 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:19.430093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b709ecf7-99b9-475c-abce-2895f74f7d36 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:19.431330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b709ecf7-99b9-475c-abce-2895f74f7d36 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:19.440246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b709ecf7-99b9-475c-abce-2895f74f7d36 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:19.440857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b709ecf7-99b9-475c-abce-2895f74f7d36 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:19.441794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b709ecf7-99b9-475c-abce-2895f74f7d36 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:19.442419 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b709ecf7-99b9-475c-abce-2895f74f7d36 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:19.734187 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b709ecf7-99b9-475c-abce-2895f74f7d36 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:19.750468 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b709ecf7-99b9-475c-abce-2895f74f7d36 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 0.322917 Apr 16 16:50:19.752605 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 20/59] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:19 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:19.872190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-94cb4548-1fe7-4ce8-8ccd-b2ebcf181b5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:19.872869 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-94cb4548-1fe7-4ce8-8ccd-b2ebcf181b5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:19.882095 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-94cb4548-1fe7-4ce8-8ccd-b2ebcf181b5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:19.882638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-94cb4548-1fe7-4ce8-8ccd-b2ebcf181b5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:19.883687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-94cb4548-1fe7-4ce8-8ccd-b2ebcf181b5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:19.884207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-94cb4548-1fe7-4ce8-8ccd-b2ebcf181b5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:19.953863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a85d3968-44db-41ec-8f43-1e0d7ca5e7fd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:19.954778 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a85d3968-44db-41ec-8f43-1e0d7ca5e7fd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:19.973066 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a85d3968-44db-41ec-8f43-1e0d7ca5e7fd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:19.974029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a85d3968-44db-41ec-8f43-1e0d7ca5e7fd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:19.978601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a85d3968-44db-41ec-8f43-1e0d7ca5e7fd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:19.979277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a85d3968-44db-41ec-8f43-1e0d7ca5e7fd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:20.459178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-94cb4548-1fe7-4ce8-8ccd-b2ebcf181b5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:20.478386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a85d3968-44db-41ec-8f43-1e0d7ca5e7fd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:20.478609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-94cb4548-1fe7-4ce8-8ccd-b2ebcf181b5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:20.480330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-94cb4548-1fe7-4ce8-8ccd-b2ebcf181b5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:20.481531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-94cb4548-1fe7-4ce8-8ccd-b2ebcf181b5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.616219 Apr 16 16:50:20.497593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 40/60] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:19 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:20.498519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a85d3968-44db-41ec-8f43-1e0d7ca5e7fd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.548650 Apr 16 16:50:20.499309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 21/61] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:19 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:20.502953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0de3ebd2-b2bc-499e-a2d3-3a8618b7087c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:20.503612 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0de3ebd2-b2bc-499e-a2d3-3a8618b7087c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:20.513541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0de3ebd2-b2bc-499e-a2d3-3a8618b7087c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:20.514409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0de3ebd2-b2bc-499e-a2d3-3a8618b7087c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:20.515440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0de3ebd2-b2bc-499e-a2d3-3a8618b7087c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:20.516462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0de3ebd2-b2bc-499e-a2d3-3a8618b7087c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:20.771290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fb0bcc2d-da9d-4b94-b9ed-e9beffc13c6f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:20.771970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fb0bcc2d-da9d-4b94-b9ed-e9beffc13c6f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:20.790306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb0bcc2d-da9d-4b94-b9ed-e9beffc13c6f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:20.794484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb0bcc2d-da9d-4b94-b9ed-e9beffc13c6f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:20.795458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb0bcc2d-da9d-4b94-b9ed-e9beffc13c6f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:20.795964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb0bcc2d-da9d-4b94-b9ed-e9beffc13c6f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:21.647093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fb0bcc2d-da9d-4b94-b9ed-e9beffc13c6f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:21.659986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fb0bcc2d-da9d-4b94-b9ed-e9beffc13c6f tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 0.893066 Apr 16 16:50:21.663673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 22/62] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:20 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:21.668803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-80c59974-e440-41c7-94c4-7d6df673d174 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:21.676920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-80c59974-e440-41c7-94c4-7d6df673d174 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:21.689685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0de3ebd2-b2bc-499e-a2d3-3a8618b7087c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:21.695367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80c59974-e440-41c7-94c4-7d6df673d174 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:21.698947 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80c59974-e440-41c7-94c4-7d6df673d174 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:21.699943 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80c59974-e440-41c7-94c4-7d6df673d174 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:21.704177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80c59974-e440-41c7-94c4-7d6df673d174 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:21.706703 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0de3ebd2-b2bc-499e-a2d3-3a8618b7087c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1321 microversion: 2.1 time: 1.207447 Apr 16 16:50:21.707464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 41/63] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:20 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1321 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:21.726553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6f44b4c2-f934-4716-a8d1-e700e190348f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:21.727277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6f44b4c2-f934-4716-a8d1-e700e190348f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:21.750685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6f44b4c2-f934-4716-a8d1-e700e190348f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:21.751201 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6f44b4c2-f934-4716-a8d1-e700e190348f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:21.757404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6f44b4c2-f934-4716-a8d1-e700e190348f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:21.758059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6f44b4c2-f934-4716-a8d1-e700e190348f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:22.402933 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6f44b4c2-f934-4716-a8d1-e700e190348f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:22.415402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6f44b4c2-f934-4716-a8d1-e700e190348f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.702526 Apr 16 16:50:22.417212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 42/64] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:21 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:22.424352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-179e258d-c97d-4288-966b-bfd0e21696b5 req-a43bb134-1e13-48e9-9369-065e3f954b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c9b9dd-948e-40a5-aa29-744166975b41", "name": "network-vif-plugged", "status": "completed", "tag": "0b5e633d-5dc8-49f9-9b83-70c95f998fa9"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:22.428051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:22.428051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:22.439233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-179e258d-c97d-4288-966b-bfd0e21696b5 req-a43bb134-1e13-48e9-9369-065e3f954b36 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:22.439968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-179e258d-c97d-4288-966b-bfd0e21696b5 req-a43bb134-1e13-48e9-9369-065e3f954b36 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:22.453649 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-80c59974-e440-41c7-94c4-7d6df673d174 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:22.469525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-80c59974-e440-41c7-94c4-7d6df673d174 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:22.478850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-80c59974-e440-41c7-94c4-7d6df673d174 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:22.480350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-80c59974-e440-41c7-94c4-7d6df673d174 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.815443 Apr 16 16:50:22.481171 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 23/65] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:21 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:22.486125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-179e258d-c97d-4288-966b-bfd0e21696b5 req-a43bb134-1e13-48e9-9369-065e3f954b36 service nova] Creating event network-vif-plugged:0b5e633d-5dc8-49f9-9b83-70c95f998fa9 for instance 85c9b9dd-948e-40a5-aa29-744166975b41 on hv-cinder-73362 Apr 16 16:50:22.495553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-179e258d-c97d-4288-966b-bfd0e21696b5 req-a43bb134-1e13-48e9-9369-065e3f954b36 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076816 Apr 16 16:50:22.496943 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 43/66] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:22.681862 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0ea89530-d730-4eb5-8631-ae56ce20db6e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:22.684040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0ea89530-d730-4eb5-8631-ae56ce20db6e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:22.694234 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ea89530-d730-4eb5-8631-ae56ce20db6e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:22.694749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ea89530-d730-4eb5-8631-ae56ce20db6e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:22.695803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ea89530-d730-4eb5-8631-ae56ce20db6e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:22.696445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ea89530-d730-4eb5-8631-ae56ce20db6e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:22.707335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-d5882b21-e1ec-4ad2-858b-266da739d213 req-51d0d929-11cd-4c23-9a9c-0f0b8f4aea55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf021fce-d230-4117-992c-f91cd978276c", "tag": "fd825542-a1af-4ba6-8c00-d64d5199c7e6"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:22.711065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:22.711065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:22.736580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-d5882b21-e1ec-4ad2-858b-266da739d213 req-51d0d929-11cd-4c23-9a9c-0f0b8f4aea55 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:22.738847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-d5882b21-e1ec-4ad2-858b-266da739d213 req-51d0d929-11cd-4c23-9a9c-0f0b8f4aea55 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:22.783330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-d5882b21-e1ec-4ad2-858b-266da739d213 req-51d0d929-11cd-4c23-9a9c-0f0b8f4aea55 service nova] Creating event network-changed:fd825542-a1af-4ba6-8c00-d64d5199c7e6 for instance bf021fce-d230-4117-992c-f91cd978276c on hv-cinder-73362 Apr 16 16:50:22.794617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-d5882b21-e1ec-4ad2-858b-266da739d213 req-51d0d929-11cd-4c23-9a9c-0f0b8f4aea55 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091281 Apr 16 16:50:22.795335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 44/67] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:22.803456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3b33a603-baa8-40de-8657-e55852f7b2b7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:22.804293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3b33a603-baa8-40de-8657-e55852f7b2b7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:22.812640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3b33a603-baa8-40de-8657-e55852f7b2b7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:22.813163 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3b33a603-baa8-40de-8657-e55852f7b2b7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:22.814019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3b33a603-baa8-40de-8657-e55852f7b2b7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:22.814561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3b33a603-baa8-40de-8657-e55852f7b2b7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:23.128078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0ea89530-d730-4eb5-8631-ae56ce20db6e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:23.138180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0ea89530-d730-4eb5-8631-ae56ce20db6e tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 0.461095 Apr 16 16:50:23.138867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 24/68] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:22 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:23.144329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-735626992", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5482311a-e6d4-4b31-99e9-5c3f3d5468e8"}], "security_groups": [{"name": "tempest-securitygroup--1380580499"}], "key_name": "tempest-keypair-1322091839", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:23.178844 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3b33a603-baa8-40de-8657-e55852f7b2b7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:23.188180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3b33a603-baa8-40de-8657-e55852f7b2b7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1510 microversion: 2.1 time: 0.389595 Apr 16 16:50:23.188978 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 45/69] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:22 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:23.208526 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-e8b0daf5-642c-4d33-9710-b0a5f9281709 req-c55c4657-c4a2-434c-bab1-fd13feb05b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59b60bc4-7bd4-4920-9a97-ac9d637dcbdc", "tag": "3ed1e123-5d85-4b45-a4c3-3b49fe2aeae9"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:23.210444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:23.210444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:23.220671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-e8b0daf5-642c-4d33-9710-b0a5f9281709 req-c55c4657-c4a2-434c-bab1-fd13feb05b60 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:23.221255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-e8b0daf5-642c-4d33-9710-b0a5f9281709 req-c55c4657-c4a2-434c-bab1-fd13feb05b60 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:23.242834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-e8b0daf5-642c-4d33-9710-b0a5f9281709 req-c55c4657-c4a2-434c-bab1-fd13feb05b60 service nova] Creating event network-changed:3ed1e123-5d85-4b45-a4c3-3b49fe2aeae9 for instance 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc on hv-cinder-73362 Apr 16 16:50:23.248549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-e8b0daf5-642c-4d33-9710-b0a5f9281709 req-c55c4657-c4a2-434c-bab1-fd13feb05b60 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044763 Apr 16 16:50:23.249223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 46/70] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:23.284625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] validate_networks() for [('5482311a-e6d4-4b31-99e9-5c3f3d5468e8', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:50:23.435979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-28310cb6-4035-4384-a1c2-36f16dafbf81 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:23.436794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-28310cb6-4035-4384-a1c2-36f16dafbf81 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:23.449871 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28310cb6-4035-4384-a1c2-36f16dafbf81 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:23.450423 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28310cb6-4035-4384-a1c2-36f16dafbf81 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:23.451446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28310cb6-4035-4384-a1c2-36f16dafbf81 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:23.451922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28310cb6-4035-4384-a1c2-36f16dafbf81 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:23.862320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-28310cb6-4035-4384-a1c2-36f16dafbf81 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:23.871909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-28310cb6-4035-4384-a1c2-36f16dafbf81 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.441142 Apr 16 16:50:23.872629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 47/71] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:23 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:23.877347 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7e6f9017-2fb7-49ed-a8bb-af49b0cc1074 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:23.878082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7e6f9017-2fb7-49ed-a8bb-af49b0cc1074 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:23.886694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e6f9017-2fb7-49ed-a8bb-af49b0cc1074 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:23.887286 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e6f9017-2fb7-49ed-a8bb-af49b0cc1074 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:23.888215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e6f9017-2fb7-49ed-a8bb-af49b0cc1074 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:23.888782 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e6f9017-2fb7-49ed-a8bb-af49b0cc1074 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:24.122408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:50:24.123116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:50:24.123660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:50:24.124118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:50:24.124582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:50:24.134614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:24.135323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:24.136202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:24.136694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:24.156026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for project 26fb0e15979d43999b94901003579a6a. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:50:24.160142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for user c2e7f3d7b43748658c69c338db617181 and project 26fb0e15979d43999b94901003579a6a. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:50:24.171890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:50:24.174903 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:50:24.185729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7e6f9017-2fb7-49ed-a8bb-af49b0cc1074 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:24.197220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7e6f9017-2fb7-49ed-a8bb-af49b0cc1074 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:24.198968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7e6f9017-2fb7-49ed-a8bb-af49b0cc1074 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:24.200132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7e6f9017-2fb7-49ed-a8bb-af49b0cc1074 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.326443 Apr 16 16:50:24.200795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 48/72] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:23 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:24.205614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1cc72dd2-4128-4c1b-8b72-aeb952f891a5 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:24.206271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1cc72dd2-4128-4c1b-8b72-aeb952f891a5 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:24.216295 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1cc72dd2-4128-4c1b-8b72-aeb952f891a5 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:24.217010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1cc72dd2-4128-4c1b-8b72-aeb952f891a5 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:24.218036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1cc72dd2-4128-4c1b-8b72-aeb952f891a5 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:24.218730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1cc72dd2-4128-4c1b-8b72-aeb952f891a5 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:24.231696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b430ec54-de7b-412e-a625-95977311d99c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.091640 Apr 16 16:50:24.232386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 25/73] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:50:23 2021] POST /compute/v2.1/servers => generated 404 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:50:24.246259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-981483f0-1201-4f5a-9e8d-cfc8f94cab4e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:24.252988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-981483f0-1201-4f5a-9e8d-cfc8f94cab4e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:24.372389 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-981483f0-1201-4f5a-9e8d-cfc8f94cab4e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:24.386002 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-981483f0-1201-4f5a-9e8d-cfc8f94cab4e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1241 microversion: 2.1 time: 0.145135 Apr 16 16:50:24.386850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 26/74] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:24 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1241 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:24.486210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1cc72dd2-4128-4c1b-8b72-aeb952f891a5 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:24.495275 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1cc72dd2-4128-4c1b-8b72-aeb952f891a5 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 0.293409 Apr 16 16:50:24.495896 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 49/75] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:24 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:24.890259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cf1150b8-a782-4199-968d-26df4e17302b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:24.890995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cf1150b8-a782-4199-968d-26df4e17302b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:24.898905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cf1150b8-a782-4199-968d-26df4e17302b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:24.899412 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cf1150b8-a782-4199-968d-26df4e17302b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:24.900248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cf1150b8-a782-4199-968d-26df4e17302b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:24.900740 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cf1150b8-a782-4199-968d-26df4e17302b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:25.112427 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cf1150b8-a782-4199-968d-26df4e17302b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:25.121984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cf1150b8-a782-4199-968d-26df4e17302b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.235617 Apr 16 16:50:25.122631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 27/76] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:24 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:25.219405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-063aa415-1c78-4d5e-9107-d73361eb45cf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:25.220070 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-063aa415-1c78-4d5e-9107-d73361eb45cf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:25.228761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-063aa415-1c78-4d5e-9107-d73361eb45cf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:25.229274 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-063aa415-1c78-4d5e-9107-d73361eb45cf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:25.230153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-063aa415-1c78-4d5e-9107-d73361eb45cf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:25.230677 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-063aa415-1c78-4d5e-9107-d73361eb45cf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:25.405259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2412c269-0a0f-406b-a544-fe6b79f66520 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:25.406009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2412c269-0a0f-406b-a544-fe6b79f66520 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:25.415149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2412c269-0a0f-406b-a544-fe6b79f66520 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:25.415659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2412c269-0a0f-406b-a544-fe6b79f66520 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:25.416502 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2412c269-0a0f-406b-a544-fe6b79f66520 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:25.416994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2412c269-0a0f-406b-a544-fe6b79f66520 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:25.453115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-063aa415-1c78-4d5e-9107-d73361eb45cf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:25.463830 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-063aa415-1c78-4d5e-9107-d73361eb45cf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:25.465519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-063aa415-1c78-4d5e-9107-d73361eb45cf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:25.466927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-063aa415-1c78-4d5e-9107-d73361eb45cf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.251405 Apr 16 16:50:25.467352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 50/77] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:25 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:25.513892 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2e249633-2b73-4688-bc8b-6a4a26259eb3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:25.514609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2e249633-2b73-4688-bc8b-6a4a26259eb3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:25.523109 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e249633-2b73-4688-bc8b-6a4a26259eb3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:25.523618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e249633-2b73-4688-bc8b-6a4a26259eb3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:25.524456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e249633-2b73-4688-bc8b-6a4a26259eb3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:25.525028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e249633-2b73-4688-bc8b-6a4a26259eb3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:25.545124 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2412c269-0a0f-406b-a544-fe6b79f66520 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:25.556976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2412c269-0a0f-406b-a544-fe6b79f66520 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1245 microversion: 2.1 time: 0.155854 Apr 16 16:50:25.557622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 28/78] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:25 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1245 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:25.854833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2e249633-2b73-4688-bc8b-6a4a26259eb3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:25.870249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2e249633-2b73-4688-bc8b-6a4a26259eb3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1318 microversion: 2.1 time: 0.360698 Apr 16 16:50:25.871899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 51/79] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:25 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:26.140096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b8c52f8f-303b-4dd9-9792-be6781fb08ae tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:26.141036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b8c52f8f-303b-4dd9-9792-be6781fb08ae tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:26.149446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8c52f8f-303b-4dd9-9792-be6781fb08ae tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:26.149921 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8c52f8f-303b-4dd9-9792-be6781fb08ae tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:26.150986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8c52f8f-303b-4dd9-9792-be6781fb08ae tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:26.151478 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8c52f8f-303b-4dd9-9792-be6781fb08ae tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:26.487333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3d9b9de7-435d-492c-990e-c8828a8fbff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:26.488480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3d9b9de7-435d-492c-990e-c8828a8fbff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:26.508510 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d9b9de7-435d-492c-990e-c8828a8fbff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:26.509238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d9b9de7-435d-492c-990e-c8828a8fbff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:26.510272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d9b9de7-435d-492c-990e-c8828a8fbff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:26.510953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d9b9de7-435d-492c-990e-c8828a8fbff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:27.238304 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b8c52f8f-303b-4dd9-9792-be6781fb08ae tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:27.255669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b8c52f8f-303b-4dd9-9792-be6781fb08ae tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 1.119226 Apr 16 16:50:27.256302 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 29/80] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:26 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:27.262806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8d3d9b5f-4a29-4512-9fa3-947de9ad2137 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:27.263651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8d3d9b5f-4a29-4512-9fa3-947de9ad2137 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:27.274019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8d3d9b5f-4a29-4512-9fa3-947de9ad2137 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:27.274756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8d3d9b5f-4a29-4512-9fa3-947de9ad2137 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:27.275757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8d3d9b5f-4a29-4512-9fa3-947de9ad2137 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:27.276397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8d3d9b5f-4a29-4512-9fa3-947de9ad2137 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:27.647765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8d3d9b5f-4a29-4512-9fa3-947de9ad2137 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:27.664385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8d3d9b5f-4a29-4512-9fa3-947de9ad2137 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1299 microversion: 2.1 time: 0.406509 Apr 16 16:50:27.665585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 30/81] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:27 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1299 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:27.672491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9411edd1-fe51-43f8-baed-87af9121a698 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:27.673739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9411edd1-fe51-43f8-baed-87af9121a698 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:27.687069 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9411edd1-fe51-43f8-baed-87af9121a698 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:27.687707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9411edd1-fe51-43f8-baed-87af9121a698 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:27.689127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9411edd1-fe51-43f8-baed-87af9121a698 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:27.698578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9411edd1-fe51-43f8-baed-87af9121a698 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:27.702612 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3d9b9de7-435d-492c-990e-c8828a8fbff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:27.724206 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3d9b9de7-435d-492c-990e-c8828a8fbff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:27.726219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3d9b9de7-435d-492c-990e-c8828a8fbff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:27.727582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3d9b9de7-435d-492c-990e-c8828a8fbff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 1.244417 Apr 16 16:50:27.728340 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 52/82] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:26 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:27.733398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3cbf7c77-f92a-4232-9708-5e4d6f2569e4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2ed96d2-05d8-4274-bd87-d6e1241cea76"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:27.735463 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3cbf7c77-f92a-4232-9708-5e4d6f2569e4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:27.761999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3cbf7c77-f92a-4232-9708-5e4d6f2569e4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:27.762535 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3cbf7c77-f92a-4232-9708-5e4d6f2569e4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:27.763386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3cbf7c77-f92a-4232-9708-5e4d6f2569e4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:27.763876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3cbf7c77-f92a-4232-9708-5e4d6f2569e4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:28.316822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3cbf7c77-f92a-4232-9708-5e4d6f2569e4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "POST /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.586826 Apr 16 16:50:28.320463 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 53/83] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:50:27 2021] POST /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:28.346658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-498a12ef-65a9-4f36-b519-c0c4331a64f2 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:28.350226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-498a12ef-65a9-4f36-b519-c0c4331a64f2 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:28.368660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-498a12ef-65a9-4f36-b519-c0c4331a64f2 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:28.369402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-498a12ef-65a9-4f36-b519-c0c4331a64f2 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:28.371708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-498a12ef-65a9-4f36-b519-c0c4331a64f2 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:28.372919 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-498a12ef-65a9-4f36-b519-c0c4331a64f2 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:28.387330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9411edd1-fe51-43f8-baed-87af9121a698 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:28.404405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9411edd1-fe51-43f8-baed-87af9121a698 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1505 microversion: 2.1 time: 0.737409 Apr 16 16:50:28.414910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 31/84] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:27 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1505 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:28.683367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4cc040e4-4c31-45e1-809d-31487fd1f481 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:28.684038 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4cc040e4-4c31-45e1-809d-31487fd1f481 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:28.704369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4cc040e4-4c31-45e1-809d-31487fd1f481 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:28.704927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4cc040e4-4c31-45e1-809d-31487fd1f481 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:28.705840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4cc040e4-4c31-45e1-809d-31487fd1f481 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:28.706363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4cc040e4-4c31-45e1-809d-31487fd1f481 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:28.935523 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4cc040e4-4c31-45e1-809d-31487fd1f481 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:28.946172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4cc040e4-4c31-45e1-809d-31487fd1f481 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1299 microversion: 2.1 time: 0.266813 Apr 16 16:50:28.947016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 32/85] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:28 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1299 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:28.952384 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a25f4df0-a21f-4727-a56f-33de389b7e1a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:28.953470 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a25f4df0-a21f-4727-a56f-33de389b7e1a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:28.996491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a25f4df0-a21f-4727-a56f-33de389b7e1a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:28.997150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a25f4df0-a21f-4727-a56f-33de389b7e1a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:28.998358 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a25f4df0-a21f-4727-a56f-33de389b7e1a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:28.999187 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a25f4df0-a21f-4727-a56f-33de389b7e1a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:29.153087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-498a12ef-65a9-4f36-b519-c0c4331a64f2 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:29.172142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-498a12ef-65a9-4f36-b519-c0c4331a64f2 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.849175 Apr 16 16:50:29.173914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 54/86] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:28 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:29.479160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a25f4df0-a21f-4727-a56f-33de389b7e1a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:29.489489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a25f4df0-a21f-4727-a56f-33de389b7e1a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:29.491587 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a25f4df0-a21f-4727-a56f-33de389b7e1a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:29.493161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a25f4df0-a21f-4727-a56f-33de389b7e1a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.544854 Apr 16 16:50:29.493968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 33/87] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:28 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:29.964808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cea85feb-9316-4520-a1dd-0c021e57ff07 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:29.965477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cea85feb-9316-4520-a1dd-0c021e57ff07 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:29.973425 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cea85feb-9316-4520-a1dd-0c021e57ff07 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:29.973899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cea85feb-9316-4520-a1dd-0c021e57ff07 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:29.974915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cea85feb-9316-4520-a1dd-0c021e57ff07 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:29.975679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cea85feb-9316-4520-a1dd-0c021e57ff07 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:30.192650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cabc176b-bfcd-486f-b439-8be0b2921dd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:30.193824 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cabc176b-bfcd-486f-b439-8be0b2921dd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:30.221037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cabc176b-bfcd-486f-b439-8be0b2921dd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:30.222218 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cabc176b-bfcd-486f-b439-8be0b2921dd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:30.226266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cabc176b-bfcd-486f-b439-8be0b2921dd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:30.227067 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cabc176b-bfcd-486f-b439-8be0b2921dd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:30.252501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cea85feb-9316-4520-a1dd-0c021e57ff07 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:30.264924 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cea85feb-9316-4520-a1dd-0c021e57ff07 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.304234 Apr 16 16:50:30.266057 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 55/88] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:29 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:30.452987 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cabc176b-bfcd-486f-b439-8be0b2921dd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:30.462161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cabc176b-bfcd-486f-b439-8be0b2921dd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.274884 Apr 16 16:50:30.463572 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 34/89] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:30 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:30.513302 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a389301e-6eef-451c-b536-36b0156aca78 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:30.513998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a389301e-6eef-451c-b536-36b0156aca78 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:30.521880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a389301e-6eef-451c-b536-36b0156aca78 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:30.522394 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a389301e-6eef-451c-b536-36b0156aca78 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:30.523427 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a389301e-6eef-451c-b536-36b0156aca78 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:30.524063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a389301e-6eef-451c-b536-36b0156aca78 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:30.768828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a389301e-6eef-451c-b536-36b0156aca78 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:30.778905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a389301e-6eef-451c-b536-36b0156aca78 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:30.780663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a389301e-6eef-451c-b536-36b0156aca78 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:30.781833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a389301e-6eef-451c-b536-36b0156aca78 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.272786 Apr 16 16:50:30.782647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 56/90] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:30 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:31.284627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-429f6cc1-1dea-4327-99a6-16b70b85914c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:31.285481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-429f6cc1-1dea-4327-99a6-16b70b85914c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:31.293164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-429f6cc1-1dea-4327-99a6-16b70b85914c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:31.293666 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-429f6cc1-1dea-4327-99a6-16b70b85914c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:31.294522 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-429f6cc1-1dea-4327-99a6-16b70b85914c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:31.295011 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-429f6cc1-1dea-4327-99a6-16b70b85914c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:31.480310 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d895c4be-91a2-47da-b52d-ca6dcc31abd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:31.481002 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d895c4be-91a2-47da-b52d-ca6dcc31abd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:31.490049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d895c4be-91a2-47da-b52d-ca6dcc31abd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:31.490588 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d895c4be-91a2-47da-b52d-ca6dcc31abd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:31.491442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d895c4be-91a2-47da-b52d-ca6dcc31abd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:31.491942 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d895c4be-91a2-47da-b52d-ca6dcc31abd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:31.510327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-429f6cc1-1dea-4327-99a6-16b70b85914c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:31.519277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-429f6cc1-1dea-4327-99a6-16b70b85914c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.239225 Apr 16 16:50:31.519962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 35/91] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:31 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:31.710101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d895c4be-91a2-47da-b52d-ca6dcc31abd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:31.719574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d895c4be-91a2-47da-b52d-ca6dcc31abd0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.243487 Apr 16 16:50:31.720344 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 57/92] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:31 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:31.801792 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-af7198c6-2178-4aba-bae3-74e8aa4638a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:31.802615 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-af7198c6-2178-4aba-bae3-74e8aa4638a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:31.810412 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af7198c6-2178-4aba-bae3-74e8aa4638a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:31.810924 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af7198c6-2178-4aba-bae3-74e8aa4638a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:31.811755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af7198c6-2178-4aba-bae3-74e8aa4638a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:31.812236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af7198c6-2178-4aba-bae3-74e8aa4638a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:32.030757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-af7198c6-2178-4aba-bae3-74e8aa4638a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:32.041317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-af7198c6-2178-4aba-bae3-74e8aa4638a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:32.043022 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-af7198c6-2178-4aba-bae3-74e8aa4638a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:32.044188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-af7198c6-2178-4aba-bae3-74e8aa4638a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.247018 Apr 16 16:50:32.045027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 36/93] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:31 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:32.539291 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-23555c44-d3c3-4df1-af0a-4ebd6f472c6d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:32.539887 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-23555c44-d3c3-4df1-af0a-4ebd6f472c6d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:32.547855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-23555c44-d3c3-4df1-af0a-4ebd6f472c6d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:32.548352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-23555c44-d3c3-4df1-af0a-4ebd6f472c6d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:32.549175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-23555c44-d3c3-4df1-af0a-4ebd6f472c6d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:32.549656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-23555c44-d3c3-4df1-af0a-4ebd6f472c6d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:32.738144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d1110d60-6552-49e6-974e-109504054e32 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:32.739165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d1110d60-6552-49e6-974e-109504054e32 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:32.748000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1110d60-6552-49e6-974e-109504054e32 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:32.748000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1110d60-6552-49e6-974e-109504054e32 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:32.748574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1110d60-6552-49e6-974e-109504054e32 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:32.749051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1110d60-6552-49e6-974e-109504054e32 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:33.085446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-23555c44-d3c3-4df1-af0a-4ebd6f472c6d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:33.095076 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-23555c44-d3c3-4df1-af0a-4ebd6f472c6d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.560448 Apr 16 16:50:33.096585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 58/94] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:32 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:33.107086 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ee04b9d9-4951-4c83-93f4-91fc8157cc28 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:33.107770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ee04b9d9-4951-4c83-93f4-91fc8157cc28 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:33.117573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee04b9d9-4951-4c83-93f4-91fc8157cc28 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:33.118087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee04b9d9-4951-4c83-93f4-91fc8157cc28 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:33.119235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee04b9d9-4951-4c83-93f4-91fc8157cc28 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:33.119437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee04b9d9-4951-4c83-93f4-91fc8157cc28 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:33.323258 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d1110d60-6552-49e6-974e-109504054e32 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:33.332259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d1110d60-6552-49e6-974e-109504054e32 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.598176 Apr 16 16:50:33.333226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 37/95] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:32 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:33.500692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ee04b9d9-4951-4c83-93f4-91fc8157cc28 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:33.512477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ee04b9d9-4951-4c83-93f4-91fc8157cc28 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:33.514940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ee04b9d9-4951-4c83-93f4-91fc8157cc28 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:33.516254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ee04b9d9-4951-4c83-93f4-91fc8157cc28 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.416961 Apr 16 16:50:33.528145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 59/96] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:33 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:33.530116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8a8b0c69-f60c-4fa9-94af-d4026e47824a tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e077a066-6eb3-4477-a52c-b728d1132d4a"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:33.531418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8a8b0c69-f60c-4fa9-94af-d4026e47824a tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:33.539782 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8a8b0c69-f60c-4fa9-94af-d4026e47824a tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:33.540300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8a8b0c69-f60c-4fa9-94af-d4026e47824a tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:33.541128 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8a8b0c69-f60c-4fa9-94af-d4026e47824a tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:33.541622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8a8b0c69-f60c-4fa9-94af-d4026e47824a tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:33.742953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8a8b0c69-f60c-4fa9-94af-d4026e47824a tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Acquired lock "compute-rpcapi-router" {{(pid=99399) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 16 16:50:33.744241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f5c9ccc8-89b1-4ff5-a847-21e5b9312255 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:33.744726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f5c9ccc8-89b1-4ff5-a847-21e5b9312255 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:33.745736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f5c9ccc8-89b1-4ff5-a847-21e5b9312255 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:33.746497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f5c9ccc8-89b1-4ff5-a847-21e5b9312255 None None] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:33.756114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.compute.rpcapi [None req-f5c9ccc8-89b1-4ff5-a847-21e5b9312255 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 16 16:50:33.757388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f5c9ccc8-89b1-4ff5-a847-21e5b9312255 None None] Releasing lock "compute-rpcapi-router" {{(pid=99399) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 16 16:50:34.112430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-100a14b2-0135-480a-815f-51eaef0f3adb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:34.113091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-100a14b2-0135-480a-815f-51eaef0f3adb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:34.121329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-100a14b2-0135-480a-815f-51eaef0f3adb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:34.122261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-100a14b2-0135-480a-815f-51eaef0f3adb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:34.123363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-100a14b2-0135-480a-815f-51eaef0f3adb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:34.124040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-100a14b2-0135-480a-815f-51eaef0f3adb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:34.160136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f5c9ccc8-89b1-4ff5-a847-21e5b9312255 None None] 10.222.0.103 "POST /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.634107 Apr 16 16:50:34.160872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 38/97] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:50:33 2021] POST /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:34.351790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-597f948a-212c-41c9-a392-91302037a7bb tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:34.366768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-597f948a-212c-41c9-a392-91302037a7bb tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:34.376860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-597f948a-212c-41c9-a392-91302037a7bb tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:34.378672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-597f948a-212c-41c9-a392-91302037a7bb tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:34.379956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-597f948a-212c-41c9-a392-91302037a7bb tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:34.380751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-597f948a-212c-41c9-a392-91302037a7bb tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:34.653028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-100a14b2-0135-480a-815f-51eaef0f3adb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:34.667838 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-100a14b2-0135-480a-815f-51eaef0f3adb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.555026 Apr 16 16:50:34.669788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 60/98] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:34 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:34.680442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-8f5ea80a-b1b3-4b9c-85c8-99d3b10a9421 req-98df6fc5-bb37-4d42-b282-4be00b874092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e97f89-9724-46b1-8d71-56732a4b3c27", "tag": "d2eed23b-d045-4095-8b56-18eb78329917"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:34.683652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:34.683652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:34.706101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-8f5ea80a-b1b3-4b9c-85c8-99d3b10a9421 req-98df6fc5-bb37-4d42-b282-4be00b874092 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:34.706998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-8f5ea80a-b1b3-4b9c-85c8-99d3b10a9421 req-98df6fc5-bb37-4d42-b282-4be00b874092 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:34.732439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-8f5ea80a-b1b3-4b9c-85c8-99d3b10a9421 req-98df6fc5-bb37-4d42-b282-4be00b874092 service nova] Creating event network-changed:d2eed23b-d045-4095-8b56-18eb78329917 for instance 22e97f89-9724-46b1-8d71-56732a4b3c27 on hv-cinder-73362 Apr 16 16:50:34.761622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-8f5ea80a-b1b3-4b9c-85c8-99d3b10a9421 req-98df6fc5-bb37-4d42-b282-4be00b874092 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089688 Apr 16 16:50:34.762794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 61/99] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:34.801156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3f5d0cc1-1648-4f1e-ad26-00aedeef7c98 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:34.805428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3f5d0cc1-1648-4f1e-ad26-00aedeef7c98 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:34.835621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3f5d0cc1-1648-4f1e-ad26-00aedeef7c98 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:34.836130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3f5d0cc1-1648-4f1e-ad26-00aedeef7c98 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:34.836972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3f5d0cc1-1648-4f1e-ad26-00aedeef7c98 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:34.837461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3f5d0cc1-1648-4f1e-ad26-00aedeef7c98 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:35.069245 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-597f948a-212c-41c9-a392-91302037a7bb tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:35.079714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-597f948a-212c-41c9-a392-91302037a7bb tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.732924 Apr 16 16:50:35.080885 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 39/100] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:34 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:35.158102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-c0bc759e-bff3-40cf-85f5-242eff2a060a req-661aeef7-6035-4a04-996d-803645bed989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "139562a9-bb46-4937-898d-cf6179ddc48d", "name": "network-vif-plugged", "status": "completed", "tag": "225036d6-cc14-48bb-962c-c75655bf76af"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:35.161282 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:35.161282 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:35.172323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-c0bc759e-bff3-40cf-85f5-242eff2a060a req-661aeef7-6035-4a04-996d-803645bed989 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:35.173064 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-c0bc759e-bff3-40cf-85f5-242eff2a060a req-661aeef7-6035-4a04-996d-803645bed989 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:35.199476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-c0bc759e-bff3-40cf-85f5-242eff2a060a req-661aeef7-6035-4a04-996d-803645bed989 service nova] Creating event network-vif-plugged:225036d6-cc14-48bb-962c-c75655bf76af for instance 139562a9-bb46-4937-898d-cf6179ddc48d on hv-cinder-73362 Apr 16 16:50:35.205510 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-c0bc759e-bff3-40cf-85f5-242eff2a060a req-661aeef7-6035-4a04-996d-803645bed989 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051242 Apr 16 16:50:35.206687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 40/101] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:50:35.447691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3f5d0cc1-1648-4f1e-ad26-00aedeef7c98 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:35.459765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3f5d0cc1-1648-4f1e-ad26-00aedeef7c98 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:35.461655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3f5d0cc1-1648-4f1e-ad26-00aedeef7c98 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:35.463029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3f5d0cc1-1648-4f1e-ad26-00aedeef7c98 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.694049 Apr 16 16:50:35.463814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 62/102] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:34 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:35.688530 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2e7f1342-6e0d-484b-b808-518141ad8bd5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:35.690000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2e7f1342-6e0d-484b-b808-518141ad8bd5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:35.699246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e7f1342-6e0d-484b-b808-518141ad8bd5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:35.699748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e7f1342-6e0d-484b-b808-518141ad8bd5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:35.700649 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e7f1342-6e0d-484b-b808-518141ad8bd5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:35.701132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e7f1342-6e0d-484b-b808-518141ad8bd5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:35.950114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2e7f1342-6e0d-484b-b808-518141ad8bd5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:35.961079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2e7f1342-6e0d-484b-b808-518141ad8bd5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.277941 Apr 16 16:50:35.961879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 41/103] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:35 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:36.099360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a86adc4b-f0f0-4de7-af51-147c459d52b4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:36.099813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a86adc4b-f0f0-4de7-af51-147c459d52b4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:36.114175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a86adc4b-f0f0-4de7-af51-147c459d52b4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:36.114770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a86adc4b-f0f0-4de7-af51-147c459d52b4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:36.115739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a86adc4b-f0f0-4de7-af51-147c459d52b4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:36.116232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a86adc4b-f0f0-4de7-af51-147c459d52b4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:36.335802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a86adc4b-f0f0-4de7-af51-147c459d52b4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:36.344901 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a86adc4b-f0f0-4de7-af51-147c459d52b4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.250241 Apr 16 16:50:36.356728 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 63/104] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:36 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:36.483238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-10bf53d9-5724-44b4-a9b3-6f711a231097 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:36.483826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-10bf53d9-5724-44b4-a9b3-6f711a231097 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:36.492049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10bf53d9-5724-44b4-a9b3-6f711a231097 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:36.492548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10bf53d9-5724-44b4-a9b3-6f711a231097 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:36.493371 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10bf53d9-5724-44b4-a9b3-6f711a231097 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:36.493859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10bf53d9-5724-44b4-a9b3-6f711a231097 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:36.709524 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-10bf53d9-5724-44b4-a9b3-6f711a231097 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:36.718942 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-10bf53d9-5724-44b4-a9b3-6f711a231097 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:36.720619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-10bf53d9-5724-44b4-a9b3-6f711a231097 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:36.721765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-10bf53d9-5724-44b4-a9b3-6f711a231097 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.242778 Apr 16 16:50:36.722391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 42/105] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:36 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:36.979624 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-814decac-09f8-47a5-a72b-8fe74c714924 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:36.980297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-814decac-09f8-47a5-a72b-8fe74c714924 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:36.988127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-814decac-09f8-47a5-a72b-8fe74c714924 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:36.989127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-814decac-09f8-47a5-a72b-8fe74c714924 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:36.990075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-814decac-09f8-47a5-a72b-8fe74c714924 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:36.990625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-814decac-09f8-47a5-a72b-8fe74c714924 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:37.211134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-814decac-09f8-47a5-a72b-8fe74c714924 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:37.219962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-814decac-09f8-47a5-a72b-8fe74c714924 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.244442 Apr 16 16:50:37.220583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 64/106] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:36 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:37.363123 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c87a0de4-548e-45d4-8f59-73df85d2718c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:37.364444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c87a0de4-548e-45d4-8f59-73df85d2718c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:37.373036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c87a0de4-548e-45d4-8f59-73df85d2718c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:37.373549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c87a0de4-548e-45d4-8f59-73df85d2718c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:37.374493 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c87a0de4-548e-45d4-8f59-73df85d2718c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:37.374953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c87a0de4-548e-45d4-8f59-73df85d2718c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:37.596431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c87a0de4-548e-45d4-8f59-73df85d2718c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:37.605657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c87a0de4-548e-45d4-8f59-73df85d2718c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.246604 Apr 16 16:50:37.606312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 43/107] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:37 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:37.741037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1c5d06ea-b644-4153-aa63-256acc1a39b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:37.741795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1c5d06ea-b644-4153-aa63-256acc1a39b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:37.749553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c5d06ea-b644-4153-aa63-256acc1a39b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:37.750077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c5d06ea-b644-4153-aa63-256acc1a39b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:37.750902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c5d06ea-b644-4153-aa63-256acc1a39b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:37.751386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c5d06ea-b644-4153-aa63-256acc1a39b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:37.980871 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1c5d06ea-b644-4153-aa63-256acc1a39b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:37.990679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1c5d06ea-b644-4153-aa63-256acc1a39b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:37.992377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1c5d06ea-b644-4153-aa63-256acc1a39b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:37.993592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1c5d06ea-b644-4153-aa63-256acc1a39b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.256745 Apr 16 16:50:37.994210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 65/108] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:37 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:38.239505 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ff305baa-8e0d-4ae5-b964-b525cfcee662 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:38.240181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ff305baa-8e0d-4ae5-b964-b525cfcee662 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:38.247992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff305baa-8e0d-4ae5-b964-b525cfcee662 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:38.248502 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff305baa-8e0d-4ae5-b964-b525cfcee662 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:38.249338 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff305baa-8e0d-4ae5-b964-b525cfcee662 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:38.249832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff305baa-8e0d-4ae5-b964-b525cfcee662 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:38.623656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c4eb46ce-cf9e-4e9e-a05e-2da306c334d7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:38.624551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c4eb46ce-cf9e-4e9e-a05e-2da306c334d7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:38.633396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4eb46ce-cf9e-4e9e-a05e-2da306c334d7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:38.633913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4eb46ce-cf9e-4e9e-a05e-2da306c334d7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:38.635259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4eb46ce-cf9e-4e9e-a05e-2da306c334d7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:38.635745 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4eb46ce-cf9e-4e9e-a05e-2da306c334d7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:38.680974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ff305baa-8e0d-4ae5-b964-b525cfcee662 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:38.690210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ff305baa-8e0d-4ae5-b964-b525cfcee662 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.455004 Apr 16 16:50:38.690968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 44/109] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:38 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:38.990553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c4eb46ce-cf9e-4e9e-a05e-2da306c334d7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:39.000819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c4eb46ce-cf9e-4e9e-a05e-2da306c334d7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.381104 Apr 16 16:50:39.001592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 66/110] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:38 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:39.023185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7d38c2c5-28f9-4e31-b7b0-0fda05aacac7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:39.024049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7d38c2c5-28f9-4e31-b7b0-0fda05aacac7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:39.032698 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d38c2c5-28f9-4e31-b7b0-0fda05aacac7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:39.033358 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d38c2c5-28f9-4e31-b7b0-0fda05aacac7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:39.034374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d38c2c5-28f9-4e31-b7b0-0fda05aacac7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:39.035024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d38c2c5-28f9-4e31-b7b0-0fda05aacac7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:39.267882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7d38c2c5-28f9-4e31-b7b0-0fda05aacac7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:39.278442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7d38c2c5-28f9-4e31-b7b0-0fda05aacac7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:39.280273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7d38c2c5-28f9-4e31-b7b0-0fda05aacac7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:39.281525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7d38c2c5-28f9-4e31-b7b0-0fda05aacac7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.262686 Apr 16 16:50:39.282235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 45/111] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:39 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:39.708878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1ff096c7-e1fa-4a54-9a88-38f9af732e2f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:39.709556 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1ff096c7-e1fa-4a54-9a88-38f9af732e2f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:39.717304 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ff096c7-e1fa-4a54-9a88-38f9af732e2f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:39.717814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ff096c7-e1fa-4a54-9a88-38f9af732e2f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:39.718682 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ff096c7-e1fa-4a54-9a88-38f9af732e2f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:39.719198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ff096c7-e1fa-4a54-9a88-38f9af732e2f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:39.943366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1ff096c7-e1fa-4a54-9a88-38f9af732e2f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:39.957005 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1ff096c7-e1fa-4a54-9a88-38f9af732e2f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.252547 Apr 16 16:50:39.958176 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 67/112] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:39 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:40.025339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4c69f3d5-303b-4893-9d46-7b667ba8ee72 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:40.025996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4c69f3d5-303b-4893-9d46-7b667ba8ee72 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:40.034223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4c69f3d5-303b-4893-9d46-7b667ba8ee72 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:40.034774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4c69f3d5-303b-4893-9d46-7b667ba8ee72 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:40.035919 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4c69f3d5-303b-4893-9d46-7b667ba8ee72 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:40.036284 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4c69f3d5-303b-4893-9d46-7b667ba8ee72 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:40.256716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4c69f3d5-303b-4893-9d46-7b667ba8ee72 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:40.265878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4c69f3d5-303b-4893-9d46-7b667ba8ee72 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.244224 Apr 16 16:50:40.266544 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 46/113] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:40 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:40.301976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1bfd8e95-2f12-4cb9-bb81-3b11862133c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:40.302658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1bfd8e95-2f12-4cb9-bb81-3b11862133c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:40.310422 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1bfd8e95-2f12-4cb9-bb81-3b11862133c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:40.310874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1bfd8e95-2f12-4cb9-bb81-3b11862133c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:40.311694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1bfd8e95-2f12-4cb9-bb81-3b11862133c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:40.312179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1bfd8e95-2f12-4cb9-bb81-3b11862133c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:40.527036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1bfd8e95-2f12-4cb9-bb81-3b11862133c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:40.537092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1bfd8e95-2f12-4cb9-bb81-3b11862133c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:40.538854 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1bfd8e95-2f12-4cb9-bb81-3b11862133c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:40.540013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1bfd8e95-2f12-4cb9-bb81-3b11862133c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.242914 Apr 16 16:50:40.540620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 68/114] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:40 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:40.975568 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9aa7bdeb-9610-4268-9af4-a62f950ad890 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:40.976149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9aa7bdeb-9610-4268-9af4-a62f950ad890 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:40.983918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9aa7bdeb-9610-4268-9af4-a62f950ad890 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:40.984413 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9aa7bdeb-9610-4268-9af4-a62f950ad890 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:40.985228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9aa7bdeb-9610-4268-9af4-a62f950ad890 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:40.985710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9aa7bdeb-9610-4268-9af4-a62f950ad890 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:41.212014 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9aa7bdeb-9610-4268-9af4-a62f950ad890 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:41.220699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9aa7bdeb-9610-4268-9af4-a62f950ad890 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.249266 Apr 16 16:50:41.221318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 47/115] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:40 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:41.283996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fa880378-f9b8-45c1-abca-613da945eb27 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:41.284666 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fa880378-f9b8-45c1-abca-613da945eb27 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:41.293016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa880378-f9b8-45c1-abca-613da945eb27 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:41.293525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa880378-f9b8-45c1-abca-613da945eb27 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:41.294395 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa880378-f9b8-45c1-abca-613da945eb27 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:41.294876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa880378-f9b8-45c1-abca-613da945eb27 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:41.510365 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fa880378-f9b8-45c1-abca-613da945eb27 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:41.519188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fa880378-f9b8-45c1-abca-613da945eb27 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.239272 Apr 16 16:50:41.520291 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 69/116] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:41 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:41.559009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-95361e35-a6e8-4e11-8f56-0c6397e53cb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:41.559657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-95361e35-a6e8-4e11-8f56-0c6397e53cb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:41.568073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-95361e35-a6e8-4e11-8f56-0c6397e53cb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:41.568571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-95361e35-a6e8-4e11-8f56-0c6397e53cb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:41.569401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-95361e35-a6e8-4e11-8f56-0c6397e53cb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:41.569890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-95361e35-a6e8-4e11-8f56-0c6397e53cb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:41.779938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-95361e35-a6e8-4e11-8f56-0c6397e53cb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:41.789462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-95361e35-a6e8-4e11-8f56-0c6397e53cb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:41.791161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-95361e35-a6e8-4e11-8f56-0c6397e53cb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:41.792341 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-95361e35-a6e8-4e11-8f56-0c6397e53cb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.237433 Apr 16 16:50:41.792946 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 48/117] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:41 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:50:42.239503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b8c63ded-e999-425c-b720-167e791ffdaf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:42.240193 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b8c63ded-e999-425c-b720-167e791ffdaf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:42.248182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8c63ded-e999-425c-b720-167e791ffdaf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:42.248687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8c63ded-e999-425c-b720-167e791ffdaf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:42.249766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8c63ded-e999-425c-b720-167e791ffdaf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:42.250257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8c63ded-e999-425c-b720-167e791ffdaf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:42.537891 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1bd4b5aa-5c83-4fa3-9c85-1767dba26166 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:42.538600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1bd4b5aa-5c83-4fa3-9c85-1767dba26166 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:42.546502 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1bd4b5aa-5c83-4fa3-9c85-1767dba26166 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:42.547019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1bd4b5aa-5c83-4fa3-9c85-1767dba26166 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:42.547856 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1bd4b5aa-5c83-4fa3-9c85-1767dba26166 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:42.548346 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1bd4b5aa-5c83-4fa3-9c85-1767dba26166 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:42.719105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b8c63ded-e999-425c-b720-167e791ffdaf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:42.729180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b8c63ded-e999-425c-b720-167e791ffdaf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.494424 Apr 16 16:50:42.729815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 70/118] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:42 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:42.811619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c63aacdc-d57d-4a45-81f4-4f83f5ad3ab0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:42.812284 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c63aacdc-d57d-4a45-81f4-4f83f5ad3ab0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:42.820280 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c63aacdc-d57d-4a45-81f4-4f83f5ad3ab0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:42.820788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c63aacdc-d57d-4a45-81f4-4f83f5ad3ab0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:42.821623 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c63aacdc-d57d-4a45-81f4-4f83f5ad3ab0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:42.822111 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c63aacdc-d57d-4a45-81f4-4f83f5ad3ab0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:43.407422 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1bd4b5aa-5c83-4fa3-9c85-1767dba26166 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:43.417573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1bd4b5aa-5c83-4fa3-9c85-1767dba26166 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.884320 Apr 16 16:50:43.418458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 49/119] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:42 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:43.674230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c63aacdc-d57d-4a45-81f4-4f83f5ad3ab0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:43.690021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c63aacdc-d57d-4a45-81f4-4f83f5ad3ab0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:43.693082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c63aacdc-d57d-4a45-81f4-4f83f5ad3ab0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:43.694649 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c63aacdc-d57d-4a45-81f4-4f83f5ad3ab0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.887136 Apr 16 16:50:43.695622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 71/120] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:42 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:50:43.747899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b0003682-c8e3-47ef-b860-7ec2401c019a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:43.748576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b0003682-c8e3-47ef-b860-7ec2401c019a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:43.757348 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b0003682-c8e3-47ef-b860-7ec2401c019a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:43.758304 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b0003682-c8e3-47ef-b860-7ec2401c019a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:43.759434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b0003682-c8e3-47ef-b860-7ec2401c019a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:43.760075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b0003682-c8e3-47ef-b860-7ec2401c019a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:44.297093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b0003682-c8e3-47ef-b860-7ec2401c019a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:44.310749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b0003682-c8e3-47ef-b860-7ec2401c019a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.567242 Apr 16 16:50:44.312508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 50/121] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:43 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:44.440187 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-69559a1c-2a78-4fb5-a3c2-5d71bda610f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:44.441026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-69559a1c-2a78-4fb5-a3c2-5d71bda610f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:44.460652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69559a1c-2a78-4fb5-a3c2-5d71bda610f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:44.461295 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69559a1c-2a78-4fb5-a3c2-5d71bda610f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:44.464364 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69559a1c-2a78-4fb5-a3c2-5d71bda610f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:44.465316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69559a1c-2a78-4fb5-a3c2-5d71bda610f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:44.716306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9a8a70b2-4bab-4660-816b-043d6535e016 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:44.717405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9a8a70b2-4bab-4660-816b-043d6535e016 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:44.728101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9a8a70b2-4bab-4660-816b-043d6535e016 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:44.728931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9a8a70b2-4bab-4660-816b-043d6535e016 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:44.729965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9a8a70b2-4bab-4660-816b-043d6535e016 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:44.730680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9a8a70b2-4bab-4660-816b-043d6535e016 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:44.800783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-69559a1c-2a78-4fb5-a3c2-5d71bda610f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:44.810448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-69559a1c-2a78-4fb5-a3c2-5d71bda610f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.378336 Apr 16 16:50:44.811304 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 72/122] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:44 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:44.880898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-2fb65d7d-0a94-4336-8fd5-84b35c8dd3d5 req-157bbce6-2431-48f2-ba49-1c28a5c91fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf021fce-d230-4117-992c-f91cd978276c", "name": "network-vif-plugged", "status": "completed", "tag": "fd825542-a1af-4ba6-8c00-d64d5199c7e6"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:44.883224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:44.883224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:44.903184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-2fb65d7d-0a94-4336-8fd5-84b35c8dd3d5 req-157bbce6-2431-48f2-ba49-1c28a5c91fd2 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:44.903685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-2fb65d7d-0a94-4336-8fd5-84b35c8dd3d5 req-157bbce6-2431-48f2-ba49-1c28a5c91fd2 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:44.931974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-2fb65d7d-0a94-4336-8fd5-84b35c8dd3d5 req-157bbce6-2431-48f2-ba49-1c28a5c91fd2 service nova] Creating event network-vif-plugged:fd825542-a1af-4ba6-8c00-d64d5199c7e6 for instance bf021fce-d230-4117-992c-f91cd978276c on hv-cinder-73362 Apr 16 16:50:44.939153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-2fb65d7d-0a94-4336-8fd5-84b35c8dd3d5 req-157bbce6-2431-48f2-ba49-1c28a5c91fd2 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062826 Apr 16 16:50:44.940335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 73/123] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:50:45.069533 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9a8a70b2-4bab-4660-816b-043d6535e016 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:45.090883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9a8a70b2-4bab-4660-816b-043d6535e016 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:45.097185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9a8a70b2-4bab-4660-816b-043d6535e016 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:45.098603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9a8a70b2-4bab-4660-816b-043d6535e016 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.387857 Apr 16 16:50:45.110368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 51/124] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:44 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:45.332020 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6e9f4e38-f760-491e-a019-41009b36a243 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:45.333565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6e9f4e38-f760-491e-a019-41009b36a243 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:45.359865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e9f4e38-f760-491e-a019-41009b36a243 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:45.363989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e9f4e38-f760-491e-a019-41009b36a243 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:45.366419 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e9f4e38-f760-491e-a019-41009b36a243 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:45.367597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e9f4e38-f760-491e-a019-41009b36a243 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:45.642638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1202361063", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "networks": [{"uuid": "4b2a2bf5-f241-4566-8a43-225171ec9f91"}]}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:45.772249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6e9f4e38-f760-491e-a019-41009b36a243 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:45.782614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6e9f4e38-f760-491e-a019-41009b36a243 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.455553 Apr 16 16:50:45.788590 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 74/125] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:45 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:45.803672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] validate_networks() for [('4b2a2bf5-f241-4566-8a43-225171ec9f91', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:50:45.829374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-52c10f64-f0d8-4f7d-aec1-6951401fb13a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:45.830102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-52c10f64-f0d8-4f7d-aec1-6951401fb13a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:45.875958 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52c10f64-f0d8-4f7d-aec1-6951401fb13a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:45.876751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52c10f64-f0d8-4f7d-aec1-6951401fb13a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:45.877775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52c10f64-f0d8-4f7d-aec1-6951401fb13a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:45.878470 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52c10f64-f0d8-4f7d-aec1-6951401fb13a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:46.305352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-52c10f64-f0d8-4f7d-aec1-6951401fb13a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:46.314988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-52c10f64-f0d8-4f7d-aec1-6951401fb13a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.489623 Apr 16 16:50:46.315858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 75/126] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:45 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:46.334761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e18fa08b-d00f-4cc8-ac21-53ef5fc4c234 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:46.335430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e18fa08b-d00f-4cc8-ac21-53ef5fc4c234 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:46.354149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e18fa08b-d00f-4cc8-ac21-53ef5fc4c234 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:46.354701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e18fa08b-d00f-4cc8-ac21-53ef5fc4c234 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:46.357963 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e18fa08b-d00f-4cc8-ac21-53ef5fc4c234 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:46.358516 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e18fa08b-d00f-4cc8-ac21-53ef5fc4c234 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:46.790405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:50:46.791467 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:50:46.792687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:50:46.793486 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:50:46.794418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:50:46.810185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:46.814437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:46.822696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:46.827324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:46.836677 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e18fa08b-d00f-4cc8-ac21-53ef5fc4c234 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:46.847543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e18fa08b-d00f-4cc8-ac21-53ef5fc4c234 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:46.849375 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e18fa08b-d00f-4cc8-ac21-53ef5fc4c234 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:46.850613 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e18fa08b-d00f-4cc8-ac21-53ef5fc4c234 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1410 microversion: 2.20 time: 0.532934 Apr 16 16:50:46.861484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 76/127] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:46 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1410 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:50:46.870506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Getting quotas for project a46c79620899432c8193a987ece333df. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:50:46.872912 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Getting quotas for user 44a48edfa5ca47949ffb787b0d7fe204 and project a46c79620899432c8193a987ece333df. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:50:46.877715 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-99dcfd6f-deb9-43e9-8fe4-d09c9c521a18 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:46.878683 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-99dcfd6f-deb9-43e9-8fe4-d09c9c521a18 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:46.887418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:50:46.888028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-99dcfd6f-deb9-43e9-8fe4-d09c9c521a18 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:46.888622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-99dcfd6f-deb9-43e9-8fe4-d09c9c521a18 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:46.889560 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-99dcfd6f-deb9-43e9-8fe4-d09c9c521a18 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:46.890148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-99dcfd6f-deb9-43e9-8fe4-d09c9c521a18 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:46.891046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:50:46.954330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e9d92d19-c2d6-405d-85b1-ad11f6d3814f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.315579 Apr 16 16:50:46.956164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 52/128] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:50:45 2021] POST /compute/v2.1/servers => generated 382 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:50:46.967277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fd008447-3170-4313-bc4c-642bf3d350c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:46.968232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fd008447-3170-4313-bc4c-642bf3d350c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:47.447330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fd008447-3170-4313-bc4c-642bf3d350c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:47.466007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fd008447-3170-4313-bc4c-642bf3d350c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1222 microversion: 2.1 time: 0.502653 Apr 16 16:50:47.468070 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 53/129] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:46 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1222 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:47.482206 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-43d75ac2-70f3-4ea8-9fb5-ad9970d77d16 req-670559eb-575d-4144-8a07-72c530106cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b60bc4-7bd4-4920-9a97-ac9d637dcbdc", "name": "network-vif-plugged", "status": "completed", "tag": "3ed1e123-5d85-4b45-a4c3-3b49fe2aeae9"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:47.487175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:47.487175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:47.497765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-43d75ac2-70f3-4ea8-9fb5-ad9970d77d16 req-670559eb-575d-4144-8a07-72c530106cbb service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:47.499137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-43d75ac2-70f3-4ea8-9fb5-ad9970d77d16 req-670559eb-575d-4144-8a07-72c530106cbb service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:47.524097 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-43d75ac2-70f3-4ea8-9fb5-ad9970d77d16 req-670559eb-575d-4144-8a07-72c530106cbb service nova] Creating event network-vif-plugged:3ed1e123-5d85-4b45-a4c3-3b49fe2aeae9 for instance 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc on hv-cinder-73362 Apr 16 16:50:47.531144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-43d75ac2-70f3-4ea8-9fb5-ad9970d77d16 req-670559eb-575d-4144-8a07-72c530106cbb service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061127 Apr 16 16:50:47.533076 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 54/130] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:47.541810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b8945646-d445-4169-bcfb-3774a49cdeee tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:47.544098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b8945646-d445-4169-bcfb-3774a49cdeee tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:47.566339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8945646-d445-4169-bcfb-3774a49cdeee tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:47.567651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8945646-d445-4169-bcfb-3774a49cdeee tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:47.569019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8945646-d445-4169-bcfb-3774a49cdeee tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:47.570054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8945646-d445-4169-bcfb-3774a49cdeee tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:47.642145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-99dcfd6f-deb9-43e9-8fe4-d09c9c521a18 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:47.651974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-99dcfd6f-deb9-43e9-8fe4-d09c9c521a18 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 0.781560 Apr 16 16:50:47.663087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 77/131] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:46 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:47.881954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-eccad8f6-e4ea-4c1f-90da-810b02c0c624 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:47.883202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-eccad8f6-e4ea-4c1f-90da-810b02c0c624 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:47.891152 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eccad8f6-e4ea-4c1f-90da-810b02c0c624 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:47.891843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eccad8f6-e4ea-4c1f-90da-810b02c0c624 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:47.892887 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eccad8f6-e4ea-4c1f-90da-810b02c0c624 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:47.893662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eccad8f6-e4ea-4c1f-90da-810b02c0c624 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:48.366377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b8945646-d445-4169-bcfb-3774a49cdeee tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:48.381053 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b8945646-d445-4169-bcfb-3774a49cdeee tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 0.846421 Apr 16 16:50:48.382103 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 55/132] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:47 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:48.485323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e913ac64-f2fe-4ee3-9079-2ecfba8d94b0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:48.485985 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e913ac64-f2fe-4ee3-9079-2ecfba8d94b0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:48.514548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e913ac64-f2fe-4ee3-9079-2ecfba8d94b0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:48.515882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e913ac64-f2fe-4ee3-9079-2ecfba8d94b0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:48.516883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e913ac64-f2fe-4ee3-9079-2ecfba8d94b0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:48.517519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e913ac64-f2fe-4ee3-9079-2ecfba8d94b0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:48.751642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-eccad8f6-e4ea-4c1f-90da-810b02c0c624 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:48.765306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-eccad8f6-e4ea-4c1f-90da-810b02c0c624 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:48.767080 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-eccad8f6-e4ea-4c1f-90da-810b02c0c624 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:48.768832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-eccad8f6-e4ea-4c1f-90da-810b02c0c624 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1603 microversion: 2.20 time: 0.891703 Apr 16 16:50:48.770598 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 78/133] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:50:47 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1603 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:50:48.772521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e913ac64-f2fe-4ee3-9079-2ecfba8d94b0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:48.776286 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-46e7fc7f-62bf-46fc-9302-3652de75cd90 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:48.777457 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-46e7fc7f-62bf-46fc-9302-3652de75cd90 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:48.791581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e913ac64-f2fe-4ee3-9079-2ecfba8d94b0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1282 microversion: 2.1 time: 0.310016 Apr 16 16:50:48.792637 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 56/134] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:48 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1282 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:48.794865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46e7fc7f-62bf-46fc-9302-3652de75cd90 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:48.795537 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46e7fc7f-62bf-46fc-9302-3652de75cd90 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:48.796523 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46e7fc7f-62bf-46fc-9302-3652de75cd90 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:48.797181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46e7fc7f-62bf-46fc-9302-3652de75cd90 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:48.798981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-784c3c99-08c3-491f-9e15-6f60b001b08a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:48.799636 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-784c3c99-08c3-491f-9e15-6f60b001b08a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:48.808825 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-784c3c99-08c3-491f-9e15-6f60b001b08a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:48.810122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-784c3c99-08c3-491f-9e15-6f60b001b08a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:48.811575 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-784c3c99-08c3-491f-9e15-6f60b001b08a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:48.812667 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-784c3c99-08c3-491f-9e15-6f60b001b08a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:49.439912 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-784c3c99-08c3-491f-9e15-6f60b001b08a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.645980 Apr 16 16:50:49.442160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 57/135] 10.222.0.103 () {60 vars in 1311 bytes} [Fri Apr 16 16:50:48 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/os-interface => generated 285 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:50:49.448133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bad392da-9b06-4f00-9b75-31b462f5996b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:49.449035 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bad392da-9b06-4f00-9b75-31b462f5996b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:49.458717 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bad392da-9b06-4f00-9b75-31b462f5996b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:49.459722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bad392da-9b06-4f00-9b75-31b462f5996b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:49.460797 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bad392da-9b06-4f00-9b75-31b462f5996b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:49.461816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bad392da-9b06-4f00-9b75-31b462f5996b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:49.904945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-46e7fc7f-62bf-46fc-9302-3652de75cd90 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:49.914215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-46e7fc7f-62bf-46fc-9302-3652de75cd90 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 1.142047 Apr 16 16:50:49.915151 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 79/136] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:48 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:49.920142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-d965e103-f202-4bf2-a3d4-44103c2e42d5 req-e9640ea4-daca-4fba-982c-38a452eaf0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e97f89-9724-46b1-8d71-56732a4b3c27", "name": "network-vif-plugged", "status": "completed", "tag": "d2eed23b-d045-4095-8b56-18eb78329917"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:49.922146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:49.922146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:49.932356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-d965e103-f202-4bf2-a3d4-44103c2e42d5 req-e9640ea4-daca-4fba-982c-38a452eaf0e3 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:49.933121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-d965e103-f202-4bf2-a3d4-44103c2e42d5 req-e9640ea4-daca-4fba-982c-38a452eaf0e3 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:49.951585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-d965e103-f202-4bf2-a3d4-44103c2e42d5 req-e9640ea4-daca-4fba-982c-38a452eaf0e3 service nova] Creating event network-vif-plugged:d2eed23b-d045-4095-8b56-18eb78329917 for instance 22e97f89-9724-46b1-8d71-56732a4b3c27 on hv-cinder-73362 Apr 16 16:50:49.957534 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-d965e103-f202-4bf2-a3d4-44103c2e42d5 req-e9640ea4-daca-4fba-982c-38a452eaf0e3 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040826 Apr 16 16:50:49.958471 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 80/137] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:49.964411 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-832b3647-7c18-48ec-908b-7200de3f26b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:49.965471 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-832b3647-7c18-48ec-908b-7200de3f26b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:49.974495 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-832b3647-7c18-48ec-908b-7200de3f26b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:49.975302 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-832b3647-7c18-48ec-908b-7200de3f26b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:49.976680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-832b3647-7c18-48ec-908b-7200de3f26b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:49.977372 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-832b3647-7c18-48ec-908b-7200de3f26b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:50.326323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-832b3647-7c18-48ec-908b-7200de3f26b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:50.337407 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-832b3647-7c18-48ec-908b-7200de3f26b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1280 microversion: 2.1 time: 0.377415 Apr 16 16:50:50.338020 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 81/138] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:49 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1280 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:50.778528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bad392da-9b06-4f00-9b75-31b462f5996b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:50.789613 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bad392da-9b06-4f00-9b75-31b462f5996b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1325 microversion: 2.1 time: 1.345382 Apr 16 16:50:50.790581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 58/139] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:49 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1325 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:50.933025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-69bf400d-1fe4-4514-99c2-04d954f0823f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:50.933726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-69bf400d-1fe4-4514-99c2-04d954f0823f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:50.943294 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69bf400d-1fe4-4514-99c2-04d954f0823f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:50.943809 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69bf400d-1fe4-4514-99c2-04d954f0823f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:50.944672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69bf400d-1fe4-4514-99c2-04d954f0823f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:50.945161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69bf400d-1fe4-4514-99c2-04d954f0823f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:51.356735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e273686b-5459-4450-bd03-7a8fd9d97c3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:51.358016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e273686b-5459-4450-bd03-7a8fd9d97c3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:51.372417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e273686b-5459-4450-bd03-7a8fd9d97c3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:51.374243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e273686b-5459-4450-bd03-7a8fd9d97c3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:51.376337 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e273686b-5459-4450-bd03-7a8fd9d97c3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:51.376828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e273686b-5459-4450-bd03-7a8fd9d97c3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:51.613810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e273686b-5459-4450-bd03-7a8fd9d97c3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:51.628429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e273686b-5459-4450-bd03-7a8fd9d97c3c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1280 microversion: 2.1 time: 0.276281 Apr 16 16:50:51.630179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 59/140] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:51 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1280 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:51.807882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-69dc16da-a4b6-418f-9f2b-1b44221a5515 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:51.809317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-69dc16da-a4b6-418f-9f2b-1b44221a5515 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:51.817764 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69dc16da-a4b6-418f-9f2b-1b44221a5515 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:51.818620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69dc16da-a4b6-418f-9f2b-1b44221a5515 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:51.819758 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69dc16da-a4b6-418f-9f2b-1b44221a5515 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:51.820399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69dc16da-a4b6-418f-9f2b-1b44221a5515 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:52.186241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-69bf400d-1fe4-4514-99c2-04d954f0823f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:52.199290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-69bf400d-1fe4-4514-99c2-04d954f0823f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1367 microversion: 2.1 time: 1.270657 Apr 16 16:50:52.200109 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 82/141] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:50 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1367 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:52.648779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-38699e44-13c2-42a5-a775-23fd7b1b5051 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:52.649745 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-38699e44-13c2-42a5-a775-23fd7b1b5051 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:52.663761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-38699e44-13c2-42a5-a775-23fd7b1b5051 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:52.667759 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-38699e44-13c2-42a5-a775-23fd7b1b5051 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:52.668868 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-38699e44-13c2-42a5-a775-23fd7b1b5051 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:52.674269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-38699e44-13c2-42a5-a775-23fd7b1b5051 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:52.848592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-69dc16da-a4b6-418f-9f2b-1b44221a5515 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:52.863814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-69dc16da-a4b6-418f-9f2b-1b44221a5515 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1519 microversion: 2.1 time: 1.059529 Apr 16 16:50:52.864474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 60/142] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:51 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1519 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:52.877150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-85ccd4e7-5208-42d6-b40f-696ea8bd3d12 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:52.878141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-85ccd4e7-5208-42d6-b40f-696ea8bd3d12 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:52.889876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85ccd4e7-5208-42d6-b40f-696ea8bd3d12 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:52.890669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85ccd4e7-5208-42d6-b40f-696ea8bd3d12 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:52.891691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85ccd4e7-5208-42d6-b40f-696ea8bd3d12 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:52.892336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85ccd4e7-5208-42d6-b40f-696ea8bd3d12 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:52.981752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-85ccd4e7-5208-42d6-b40f-696ea8bd3d12 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Going to try to terminate instance {{(pid=99399) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:50:53.200662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-85ccd4e7-5208-42d6-b40f-696ea8bd3d12 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "DELETE /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 204 len: 0 microversion: 2.1 time: 0.334409 Apr 16 16:50:53.201745 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 61/143] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:50:52 2021] DELETE /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:50:53.225585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6c896fae-b378-464e-a185-7def895870ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:53.234330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6c896fae-b378-464e-a185-7def895870ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:53.249216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-38699e44-13c2-42a5-a775-23fd7b1b5051 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:53.258568 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-38699e44-13c2-42a5-a775-23fd7b1b5051 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1280 microversion: 2.1 time: 0.615179 Apr 16 16:50:53.259211 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 83/144] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:52 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1280 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:53.265835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6c896fae-b378-464e-a185-7def895870ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:53.268226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6c896fae-b378-464e-a185-7def895870ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:53.269271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6c896fae-b378-464e-a185-7def895870ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:53.271908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6c896fae-b378-464e-a185-7def895870ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:53.291791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f4a5cb90-a143-4129-9847-d6411d112a66 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:53.295055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f4a5cb90-a143-4129-9847-d6411d112a66 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:53.324197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f4a5cb90-a143-4129-9847-d6411d112a66 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:53.324864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f4a5cb90-a143-4129-9847-d6411d112a66 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:53.325945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f4a5cb90-a143-4129-9847-d6411d112a66 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:53.327398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f4a5cb90-a143-4129-9847-d6411d112a66 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:53.415821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-6c896fae-b378-464e-a185-7def895870ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lazy-loading 'flavor' on Instance uuid 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:50:53.625391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6c896fae-b378-464e-a185-7def895870ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "POST /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc/action" status: 200 len: 32 microversion: 2.1 time: 0.421359 Apr 16 16:50:53.626875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 62/145] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:50:53 2021] POST /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc/action => generated 32 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:50:53.638055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-343f6c9e-5dcb-4acb-a843-3730aa8410a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:53.638879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-343f6c9e-5dcb-4acb-a843-3730aa8410a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:53.648791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-343f6c9e-5dcb-4acb-a843-3730aa8410a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:53.649682 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-343f6c9e-5dcb-4acb-a843-3730aa8410a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:53.650692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-343f6c9e-5dcb-4acb-a843-3730aa8410a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:53.651327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-343f6c9e-5dcb-4acb-a843-3730aa8410a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:54.434706 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f4a5cb90-a143-4129-9847-d6411d112a66 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:54.445818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f4a5cb90-a143-4129-9847-d6411d112a66 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1557 microversion: 2.1 time: 1.171479 Apr 16 16:50:54.446735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 84/146] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:53 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1557 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:54.463468 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-da62d719-e9a3-451d-9d73-48a6233e067f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:54.464261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-da62d719-e9a3-451d-9d73-48a6233e067f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:54.473643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da62d719-e9a3-451d-9d73-48a6233e067f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:54.474434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da62d719-e9a3-451d-9d73-48a6233e067f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:54.475451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da62d719-e9a3-451d-9d73-48a6233e067f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:54.476060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da62d719-e9a3-451d-9d73-48a6233e067f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:54.858516 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-343f6c9e-5dcb-4acb-a843-3730aa8410a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:54.872860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-343f6c9e-5dcb-4acb-a843-3730aa8410a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1553 microversion: 2.1 time: 1.241901 Apr 16 16:50:54.875875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 63/147] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:53 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1553 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:54.884161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5c8d9890-69ce-49c3-8508-063e5ff5db7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:54.885141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5c8d9890-69ce-49c3-8508-063e5ff5db7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:54.896560 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c8d9890-69ce-49c3-8508-063e5ff5db7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:54.897748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c8d9890-69ce-49c3-8508-063e5ff5db7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:54.898984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c8d9890-69ce-49c3-8508-063e5ff5db7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:54.899613 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c8d9890-69ce-49c3-8508-063e5ff5db7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:55.505156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-da62d719-e9a3-451d-9d73-48a6233e067f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:55.520352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-da62d719-e9a3-451d-9d73-48a6233e067f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 1.061027 Apr 16 16:50:55.534118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 85/148] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:54 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:55.549265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3e49e128-9312-4d79-937b-c9e43d135084 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:55.550727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3e49e128-9312-4d79-937b-c9e43d135084 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:55.579988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3e49e128-9312-4d79-937b-c9e43d135084 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:55.581301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3e49e128-9312-4d79-937b-c9e43d135084 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:55.584691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3e49e128-9312-4d79-937b-c9e43d135084 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:55.585321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3e49e128-9312-4d79-937b-c9e43d135084 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:55.720716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3e49e128-9312-4d79-937b-c9e43d135084 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 14 microversion: 2.20 time: 0.185036 Apr 16 16:50:55.722121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 86/149] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:50:55 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:55.730162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-4bb231cf-bbe3-45d9-83bf-7b92291b033f req-8bc906d9-5a6e-4965-a387-de055196a4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf021fce-d230-4117-992c-f91cd978276c", "tag": "fd825542-a1af-4ba6-8c00-d64d5199c7e6"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:55.735136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:55.735136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:55.751766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-4bb231cf-bbe3-45d9-83bf-7b92291b033f req-8bc906d9-5a6e-4965-a387-de055196a4a6 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:55.752424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-4bb231cf-bbe3-45d9-83bf-7b92291b033f req-8bc906d9-5a6e-4965-a387-de055196a4a6 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:55.773437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-4bb231cf-bbe3-45d9-83bf-7b92291b033f req-8bc906d9-5a6e-4965-a387-de055196a4a6 service nova] Creating event network-changed:fd825542-a1af-4ba6-8c00-d64d5199c7e6 for instance bf021fce-d230-4117-992c-f91cd978276c on hv-cinder-73362 Apr 16 16:50:55.779329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-4bb231cf-bbe3-45d9-83bf-7b92291b033f req-8bc906d9-5a6e-4965-a387-de055196a4a6 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055059 Apr 16 16:50:55.780141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 87/150] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:55.786794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f77a14d1-b68a-4c00-8254-5e2c344862a7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:55.787607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f77a14d1-b68a-4c00-8254-5e2c344862a7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:55.796532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f77a14d1-b68a-4c00-8254-5e2c344862a7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:55.809218 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f77a14d1-b68a-4c00-8254-5e2c344862a7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:55.811023 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f77a14d1-b68a-4c00-8254-5e2c344862a7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:55.811766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f77a14d1-b68a-4c00-8254-5e2c344862a7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:55.872185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5c8d9890-69ce-49c3-8508-063e5ff5db7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:55.887120 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5c8d9890-69ce-49c3-8508-063e5ff5db7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1322 microversion: 2.1 time: 1.008403 Apr 16 16:50:55.887786 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 64/151] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:54 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1322 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:55.892683 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5f3ba6c6-0851-47ee-a1ea-32db2094eebe tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:55.893339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5f3ba6c6-0851-47ee-a1ea-32db2094eebe tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:55.918949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f3ba6c6-0851-47ee-a1ea-32db2094eebe tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:55.919461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f3ba6c6-0851-47ee-a1ea-32db2094eebe tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:55.920300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f3ba6c6-0851-47ee-a1ea-32db2094eebe tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:55.921123 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f3ba6c6-0851-47ee-a1ea-32db2094eebe tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:56.779099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f77a14d1-b68a-4c00-8254-5e2c344862a7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.990617 Apr 16 16:50:56.790444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 88/152] 10.222.0.103 () {58 vars in 1270 bytes} [Fri Apr 16 16:50:55 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/os-interface => generated 284 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:50:56.796884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f09db0e2-86a7-44ef-af42-341e6d9bf0f3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:56.797795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f09db0e2-86a7-44ef-af42-341e6d9bf0f3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:56.814194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f09db0e2-86a7-44ef-af42-341e6d9bf0f3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:56.815411 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f09db0e2-86a7-44ef-af42-341e6d9bf0f3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:56.816513 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f09db0e2-86a7-44ef-af42-341e6d9bf0f3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:56.817203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f09db0e2-86a7-44ef-af42-341e6d9bf0f3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:57.765742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5f3ba6c6-0851-47ee-a1ea-32db2094eebe tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:57.782170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5f3ba6c6-0851-47ee-a1ea-32db2094eebe tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1557 microversion: 2.1 time: 1.891418 Apr 16 16:50:57.784536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 65/153] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:55 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1557 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:57.799885 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9475c577-cf90-45d3-9953-1b9365cb414f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:57.801075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9475c577-cf90-45d3-9953-1b9365cb414f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:57.810542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9475c577-cf90-45d3-9953-1b9365cb414f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:57.811246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9475c577-cf90-45d3-9953-1b9365cb414f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:57.812292 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9475c577-cf90-45d3-9953-1b9365cb414f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:57.812933 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9475c577-cf90-45d3-9953-1b9365cb414f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:57.944744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9475c577-cf90-45d3-9953-1b9365cb414f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 14 microversion: 2.20 time: 0.148047 Apr 16 16:50:57.945821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 66/154] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:50:57 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:57.954316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2b882b73-c91e-4f5c-971a-fe53df63a3ec tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:57.955456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2b882b73-c91e-4f5c-971a-fe53df63a3ec tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:57.970571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b882b73-c91e-4f5c-971a-fe53df63a3ec tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:57.971574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b882b73-c91e-4f5c-971a-fe53df63a3ec tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:57.973240 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b882b73-c91e-4f5c-971a-fe53df63a3ec tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:57.973948 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b882b73-c91e-4f5c-971a-fe53df63a3ec tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:58.309667 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f09db0e2-86a7-44ef-af42-341e6d9bf0f3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:58.325334 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f09db0e2-86a7-44ef-af42-341e6d9bf0f3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 1.532935 Apr 16 16:50:58.326168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 89/155] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:56 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:58.407775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-4a19d5b1-d5c2-4ac3-921f-d733e672ccf5 req-b5e50812-3b61-4897-a34b-12b6053e727e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c9b9dd-948e-40a5-aa29-744166975b41", "name": "network-vif-deleted", "tag": "0b5e633d-5dc8-49f9-9b83-70c95f998fa9"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:58.409474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:50:58.409474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:50:58.419144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-4a19d5b1-d5c2-4ac3-921f-d733e672ccf5 req-b5e50812-3b61-4897-a34b-12b6053e727e service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:58.419929 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-4a19d5b1-d5c2-4ac3-921f-d733e672ccf5 req-b5e50812-3b61-4897-a34b-12b6053e727e service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:58.438248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-4a19d5b1-d5c2-4ac3-921f-d733e672ccf5 req-b5e50812-3b61-4897-a34b-12b6053e727e service nova] Creating event network-vif-deleted:0b5e633d-5dc8-49f9-9b83-70c95f998fa9 for instance 85c9b9dd-948e-40a5-aa29-744166975b41 on hv-cinder-73362 Apr 16 16:50:58.444125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-4a19d5b1-d5c2-4ac3-921f-d733e672ccf5 req-b5e50812-3b61-4897-a34b-12b6053e727e service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040291 Apr 16 16:50:58.444770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 90/156] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:50:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:50:58.804783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f765db07-fd97-4b09-a798-eb0eb46cbf13 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:58.805714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f765db07-fd97-4b09-a798-eb0eb46cbf13 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:58.814048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f765db07-fd97-4b09-a798-eb0eb46cbf13 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:58.814535 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f765db07-fd97-4b09-a798-eb0eb46cbf13 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:58.815417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f765db07-fd97-4b09-a798-eb0eb46cbf13 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:58.815911 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f765db07-fd97-4b09-a798-eb0eb46cbf13 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:59.041684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f765db07-fd97-4b09-a798-eb0eb46cbf13 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a019fec4cf854661b1899f9e065946c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4509f4d9074c578fb7a7179ade0427', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:59.054135 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f765db07-fd97-4b09-a798-eb0eb46cbf13 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 200 len: 1349 microversion: 2.1 time: 0.255308 Apr 16 16:50:59.055076 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 91/157] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:58 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 1349 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:50:59.073750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-57629008-c3e6-49d5-a4dd-58365fdf6899 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:50:59.075593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-57629008-c3e6-49d5-a4dd-58365fdf6899 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:59.087177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-57629008-c3e6-49d5-a4dd-58365fdf6899 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:59.088164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-57629008-c3e6-49d5-a4dd-58365fdf6899 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:59.089386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-57629008-c3e6-49d5-a4dd-58365fdf6899 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:59.090599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-57629008-c3e6-49d5-a4dd-58365fdf6899 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:59.221581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-57629008-c3e6-49d5-a4dd-58365fdf6899 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 14 microversion: 2.20 time: 0.155061 Apr 16 16:50:59.226554 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 92/158] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:50:59 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:59.241896 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2b882b73-c91e-4f5c-971a-fe53df63a3ec tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:50:59.262697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2b882b73-c91e-4f5c-971a-fe53df63a3ec tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1322 microversion: 2.1 time: 1.313555 Apr 16 16:50:59.263485 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 67/159] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:57 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1322 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:50:59.345209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ac0fe0b8-02c8-442c-af94-1776ec1ad0e5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:50:59.345986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ac0fe0b8-02c8-442c-af94-1776ec1ad0e5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:50:59.354902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ac0fe0b8-02c8-442c-af94-1776ec1ad0e5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:59.355420 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ac0fe0b8-02c8-442c-af94-1776ec1ad0e5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:50:59.356265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ac0fe0b8-02c8-442c-af94-1776ec1ad0e5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:50:59.356760 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ac0fe0b8-02c8-442c-af94-1776ec1ad0e5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:00.064518 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-1d41c112-b93d-4ea5-a905-614a7b8bf8bc req-2a6ab9d3-f971-4160-876b-9fbe06d138ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6362be-f2e6-4f47-ae72-f6f8b12063dd", "tag": "d1974541-0b41-4461-a761-f565ef4eb7b8"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:00.068781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:51:00.068781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:51:00.092683 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-1d41c112-b93d-4ea5-a905-614a7b8bf8bc req-2a6ab9d3-f971-4160-876b-9fbe06d138ab service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:00.098339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-1d41c112-b93d-4ea5-a905-614a7b8bf8bc req-2a6ab9d3-f971-4160-876b-9fbe06d138ab service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:00.128633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-1d41c112-b93d-4ea5-a905-614a7b8bf8bc req-2a6ab9d3-f971-4160-876b-9fbe06d138ab service nova] Creating event network-changed:d1974541-0b41-4461-a761-f565ef4eb7b8 for instance 9d6362be-f2e6-4f47-ae72-f6f8b12063dd on hv-cinder-73362 Apr 16 16:51:00.135829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-1d41c112-b93d-4ea5-a905-614a7b8bf8bc req-2a6ab9d3-f971-4160-876b-9fbe06d138ab service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075723 Apr 16 16:51:00.137025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 68/160] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:51:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:00.143310 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-148d742b-ac45-4154-ba55-c873fe5005d9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:00.144387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-148d742b-ac45-4154-ba55-c873fe5005d9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:00.153710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-148d742b-ac45-4154-ba55-c873fe5005d9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:00.154508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-148d742b-ac45-4154-ba55-c873fe5005d9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:00.155719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-148d742b-ac45-4154-ba55-c873fe5005d9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:00.156399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-148d742b-ac45-4154-ba55-c873fe5005d9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:00.260137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-148d742b-ac45-4154-ba55-c873fe5005d9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] HTTP exception thrown: Instance 85c9b9dd-948e-40a5-aa29-744166975b41 could not be found. Apr 16 16:51:00.260858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-148d742b-ac45-4154-ba55-c873fe5005d9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Returning 404 to user: Instance 85c9b9dd-948e-40a5-aa29-744166975b41 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:51:00.265586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-148d742b-ac45-4154-ba55-c873fe5005d9 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 404 len: 111 microversion: 2.1 time: 0.126558 Apr 16 16:51:00.266850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 69/161] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:00 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:51:00.289716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ac0fe0b8-02c8-442c-af94-1776ec1ad0e5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:00.294973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-43a88d32-b430-445d-9ee3-d5c106d4f071 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:00.296293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-43a88d32-b430-445d-9ee3-d5c106d4f071 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:00.312806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ac0fe0b8-02c8-442c-af94-1776ec1ad0e5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.972223 Apr 16 16:51:00.313661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-43a88d32-b430-445d-9ee3-d5c106d4f071 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:00.313815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 93/162] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:50:59 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:00.319632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e1149ee9-3cfb-4371-b737-f911e72dc4cc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:00.320039 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-43a88d32-b430-445d-9ee3-d5c106d4f071 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:00.320543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e1149ee9-3cfb-4371-b737-f911e72dc4cc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:00.324927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-43a88d32-b430-445d-9ee3-d5c106d4f071 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:00.325686 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-43a88d32-b430-445d-9ee3-d5c106d4f071 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:00.339979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1149ee9-3cfb-4371-b737-f911e72dc4cc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:00.340660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1149ee9-3cfb-4371-b737-f911e72dc4cc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:00.341638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1149ee9-3cfb-4371-b737-f911e72dc4cc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:00.342236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1149ee9-3cfb-4371-b737-f911e72dc4cc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:00.527629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-43a88d32-b430-445d-9ee3-d5c106d4f071 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 14 microversion: 2.20 time: 0.258824 Apr 16 16:51:00.529296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 70/163] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:00 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 14 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:01.335932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-29e014a6-2370-45af-aaa4-89ff083d01c9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:01.336768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-29e014a6-2370-45af-aaa4-89ff083d01c9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:01.366390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29e014a6-2370-45af-aaa4-89ff083d01c9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:01.366917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29e014a6-2370-45af-aaa4-89ff083d01c9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:01.367775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29e014a6-2370-45af-aaa4-89ff083d01c9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:01.368320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29e014a6-2370-45af-aaa4-89ff083d01c9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:01.544683 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e1149ee9-3cfb-4371-b737-f911e72dc4cc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:01.565830 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e1149ee9-3cfb-4371-b737-f911e72dc4cc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1322 microversion: 2.1 time: 1.250758 Apr 16 16:51:01.566807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 94/164] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:00 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1322 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:01.573019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b494c03d-8fe9-44b9-a168-112550c4aaaf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:01.574400 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b494c03d-8fe9-44b9-a168-112550c4aaaf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:01.583735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b494c03d-8fe9-44b9-a168-112550c4aaaf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:01.586899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b494c03d-8fe9-44b9-a168-112550c4aaaf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:01.587994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b494c03d-8fe9-44b9-a168-112550c4aaaf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:01.591738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b494c03d-8fe9-44b9-a168-112550c4aaaf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:01.774493 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b494c03d-8fe9-44b9-a168-112550c4aaaf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 14 microversion: 2.20 time: 0.204990 Apr 16 16:51:01.775621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 95/165] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:01 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:01.782695 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ea3fd926-d4fd-4333-ba89-77df02315fe0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:01.787699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ea3fd926-d4fd-4333-ba89-77df02315fe0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:01.800403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ea3fd926-d4fd-4333-ba89-77df02315fe0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:01.801393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ea3fd926-d4fd-4333-ba89-77df02315fe0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:01.802503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ea3fd926-d4fd-4333-ba89-77df02315fe0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:01.803207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ea3fd926-d4fd-4333-ba89-77df02315fe0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:01.939777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ea3fd926-d4fd-4333-ba89-77df02315fe0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 14 microversion: 2.1 time: 0.162296 Apr 16 16:51:01.940646 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 96/166] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:01 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:51:01.949068 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1425522499", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "networks": [{"uuid": "f0049d23-d06a-45a0-91cb-3ec160e2a601"}]}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:02.163010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] validate_networks() for [('f0049d23-d06a-45a0-91cb-3ec160e2a601', None, None, None)] {{(pid=99398) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:51:02.532373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-29e014a6-2370-45af-aaa4-89ff083d01c9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:02.551089 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-29e014a6-2370-45af-aaa4-89ff083d01c9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 1.220050 Apr 16 16:51:02.551731 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 71/167] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:01 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:02.566640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6819d220-0e95-427e-af45-048fd336cca3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:02.567299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6819d220-0e95-427e-af45-048fd336cca3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:02.585445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6819d220-0e95-427e-af45-048fd336cca3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:02.585952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6819d220-0e95-427e-af45-048fd336cca3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:02.599192 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6819d220-0e95-427e-af45-048fd336cca3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:02.599671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6819d220-0e95-427e-af45-048fd336cca3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:02.717954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-6819d220-0e95-427e-af45-048fd336cca3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] HTTP exception thrown: Instance 85c9b9dd-948e-40a5-aa29-744166975b41 could not be found. Apr 16 16:51:02.718722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6819d220-0e95-427e-af45-048fd336cca3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Returning 404 to user: Instance 85c9b9dd-948e-40a5-aa29-744166975b41 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:51:02.719609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6819d220-0e95-427e-af45-048fd336cca3 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "DELETE /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 404 len: 111 microversion: 2.1 time: 0.157089 Apr 16 16:51:02.724890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 72/168] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:51:02 2021] DELETE /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:51:02.731536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-d26a8542-7fd3-4359-99d2-f0d579c47634 req-5336768d-d510-4549-979e-4cfd903408fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e97f89-9724-46b1-8d71-56732a4b3c27", "tag": "d2eed23b-d045-4095-8b56-18eb78329917"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:02.744447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:51:02.744447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:51:02.774878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-d26a8542-7fd3-4359-99d2-f0d579c47634 req-5336768d-d510-4549-979e-4cfd903408fc service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:02.775745 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-d26a8542-7fd3-4359-99d2-f0d579c47634 req-5336768d-d510-4549-979e-4cfd903408fc service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:02.796028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-d26a8542-7fd3-4359-99d2-f0d579c47634 req-5336768d-d510-4549-979e-4cfd903408fc service nova] Creating event network-changed:d2eed23b-d045-4095-8b56-18eb78329917 for instance 22e97f89-9724-46b1-8d71-56732a4b3c27 on hv-cinder-73362 Apr 16 16:51:02.801788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-d26a8542-7fd3-4359-99d2-f0d579c47634 req-5336768d-d510-4549-979e-4cfd903408fc service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075142 Apr 16 16:51:02.802804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 73/169] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:51:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:02.808575 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0ece09a4-dd91-448c-bfee-2978998ca416 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:02.809411 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0ece09a4-dd91-448c-bfee-2978998ca416 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:02.828861 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ece09a4-dd91-448c-bfee-2978998ca416 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:02.829731 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ece09a4-dd91-448c-bfee-2978998ca416 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:02.830829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ece09a4-dd91-448c-bfee-2978998ca416 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:02.831527 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ece09a4-dd91-448c-bfee-2978998ca416 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:03.887466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Flavor limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:51:03.888553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Image limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:51:03.889335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Flavor pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:51:03.889984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Image pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:51:03.890671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:51:03.903170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:03.903894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:03.904974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:03.908262 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:03.949674 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Getting quotas for project 1d5f124676424457a8eb80eafbc0b97d. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:51:03.955672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Getting quotas for user ba3fd35d4ec74a419ff480b118cefaee and project 1d5f124676424457a8eb80eafbc0b97d. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:51:03.981098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Going to run 1 instances... {{(pid=99398) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:51:03.984210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:51:04.099986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c358239c-0363-4883-8ebe-3487a04781b6 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.156193 Apr 16 16:51:04.105990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 97/170] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:51:01 2021] POST /compute/v2.1/servers => generated 382 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:51:04.110214 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5ee3c0d7-947f-4d04-b932-e29e3293b2f0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:04.111971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5ee3c0d7-947f-4d04-b932-e29e3293b2f0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] [instance: 85c9b9dd-948e-40a5-aa29-744166975b41] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:04.132765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0ece09a4-dd91-448c-bfee-2978998ca416 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:04.133716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5ee3c0d7-947f-4d04-b932-e29e3293b2f0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:04.134465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5ee3c0d7-947f-4d04-b932-e29e3293b2f0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:04.135528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5ee3c0d7-947f-4d04-b932-e29e3293b2f0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:04.136197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5ee3c0d7-947f-4d04-b932-e29e3293b2f0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:04.149976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0ece09a4-dd91-448c-bfee-2978998ca416 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1322 microversion: 2.1 time: 1.345601 Apr 16 16:51:04.170409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 74/171] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:02 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1322 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:04.185813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-98f1bf93-2684-4452-9834-8c737d5e4a6d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:04.187550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-98f1bf93-2684-4452-9834-8c737d5e4a6d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:04.205628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-98f1bf93-2684-4452-9834-8c737d5e4a6d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:04.209577 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-98f1bf93-2684-4452-9834-8c737d5e4a6d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:04.210902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-98f1bf93-2684-4452-9834-8c737d5e4a6d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:04.212858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-98f1bf93-2684-4452-9834-8c737d5e4a6d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:04.222255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-5ee3c0d7-947f-4d04-b932-e29e3293b2f0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] HTTP exception thrown: Instance 85c9b9dd-948e-40a5-aa29-744166975b41 could not be found. Apr 16 16:51:04.223506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5ee3c0d7-947f-4d04-b932-e29e3293b2f0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] Returning 404 to user: Instance 85c9b9dd-948e-40a5-aa29-744166975b41 could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:51:04.229193 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5ee3c0d7-947f-4d04-b932-e29e3293b2f0 tempest-DeleteServersTestJSON-2087839784 tempest-DeleteServersTestJSON-2087839784-project] 10.222.0.103 "GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41" status: 404 len: 111 microversion: 2.1 time: 0.126809 Apr 16 16:51:04.230007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 98/172] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:04 2021] GET /compute/v2.1/servers/85c9b9dd-948e-40a5-aa29-744166975b41 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:51:04.239177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c5f2401b-b9b4-474a-8f3f-bf27267b5261 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:04.240865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c5f2401b-b9b4-474a-8f3f-bf27267b5261 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:04.248893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c5f2401b-b9b4-474a-8f3f-bf27267b5261 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:04.249669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c5f2401b-b9b4-474a-8f3f-bf27267b5261 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:04.250752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c5f2401b-b9b4-474a-8f3f-bf27267b5261 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:04.251418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c5f2401b-b9b4-474a-8f3f-bf27267b5261 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:04.389418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c5f2401b-b9b4-474a-8f3f-bf27267b5261 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 14 microversion: 2.1 time: 0.154462 Apr 16 16:51:04.390106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 99/173] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:04 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:51:04.396105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a750796f-09e3-49e2-b056-b892403360b5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:04.396872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a750796f-09e3-49e2-b056-b892403360b5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:04.412007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a750796f-09e3-49e2-b056-b892403360b5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:04.412750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a750796f-09e3-49e2-b056-b892403360b5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:04.413757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a750796f-09e3-49e2-b056-b892403360b5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:04.414442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a750796f-09e3-49e2-b056-b892403360b5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:04.438150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-98f1bf93-2684-4452-9834-8c737d5e4a6d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 14 microversion: 2.20 time: 0.265026 Apr 16 16:51:04.439066 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 75/174] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:04 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 14 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:04.445181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c6aff81d-729c-428a-9e67-4813183ffdd8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:04.446160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c6aff81d-729c-428a-9e67-4813183ffdd8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:05.074265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c6aff81d-729c-428a-9e67-4813183ffdd8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:05.084710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c6aff81d-729c-428a-9e67-4813183ffdd8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1218 microversion: 2.1 time: 0.643935 Apr 16 16:51:05.085784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 76/175] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:04 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1218 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:05.188963 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f53947db-c2de-474d-8751-0686415004eb tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:05.189883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f53947db-c2de-474d-8751-0686415004eb tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:05.222871 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f53947db-c2de-474d-8751-0686415004eb tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:05.225338 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f53947db-c2de-474d-8751-0686415004eb tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:05.226395 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f53947db-c2de-474d-8751-0686415004eb tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:05.235741 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f53947db-c2de-474d-8751-0686415004eb tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:05.272202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a750796f-09e3-49e2-b056-b892403360b5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:05.284300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a750796f-09e3-49e2-b056-b892403360b5 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.892381 Apr 16 16:51:05.293148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 100/176] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:04 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:05.401640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d6d69106-6b02-4ff7-ac04-b087296704cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:05.403491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d6d69106-6b02-4ff7-ac04-b087296704cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:05.422492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d6d69106-6b02-4ff7-ac04-b087296704cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:05.423254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d6d69106-6b02-4ff7-ac04-b087296704cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:05.426090 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d6d69106-6b02-4ff7-ac04-b087296704cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:05.428585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d6d69106-6b02-4ff7-ac04-b087296704cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:05.552435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f53947db-c2de-474d-8751-0686415004eb tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:05.565243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f53947db-c2de-474d-8751-0686415004eb tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1322 microversion: 2.1 time: 0.380296 Apr 16 16:51:05.567578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 77/177] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:05 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:05.575447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4fb0651f-e49a-43b9-8eb1-5e0dba61218a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:05.576658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4fb0651f-e49a-43b9-8eb1-5e0dba61218a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:05.586418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d6d69106-6b02-4ff7-ac04-b087296704cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 14 microversion: 2.1 time: 0.188833 Apr 16 16:51:05.589696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 101/178] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:05 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:51:05.592808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4fb0651f-e49a-43b9-8eb1-5e0dba61218a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:05.593604 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4fb0651f-e49a-43b9-8eb1-5e0dba61218a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:05.594759 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4fb0651f-e49a-43b9-8eb1-5e0dba61218a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:05.595263 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4fb0651f-e49a-43b9-8eb1-5e0dba61218a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:05.743067 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4fb0651f-e49a-43b9-8eb1-5e0dba61218a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 14 microversion: 2.20 time: 0.172870 Apr 16 16:51:05.746631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 78/179] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:05 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:06.106846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f31ae756-f454-470d-be79-27afe60ea6a8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:06.107837 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f31ae756-f454-470d-be79-27afe60ea6a8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:06.119079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f31ae756-f454-470d-be79-27afe60ea6a8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:06.119714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f31ae756-f454-470d-be79-27afe60ea6a8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:06.121545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f31ae756-f454-470d-be79-27afe60ea6a8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:06.122462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f31ae756-f454-470d-be79-27afe60ea6a8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:06.312795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c758ceeb-aa5f-4225-b7a0-1be2277d571c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:06.313907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c758ceeb-aa5f-4225-b7a0-1be2277d571c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:06.344333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c758ceeb-aa5f-4225-b7a0-1be2277d571c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:06.349527 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c758ceeb-aa5f-4225-b7a0-1be2277d571c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:06.350685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c758ceeb-aa5f-4225-b7a0-1be2277d571c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:06.351309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c758ceeb-aa5f-4225-b7a0-1be2277d571c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:06.649851 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f31ae756-f454-470d-be79-27afe60ea6a8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:06.664097 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f31ae756-f454-470d-be79-27afe60ea6a8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1278 microversion: 2.1 time: 0.563469 Apr 16 16:51:06.665598 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 102/180] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:06 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1278 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:06.672609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c5f4ad7e-10ec-444c-ba22-6f678f7f079e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:06.673733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c5f4ad7e-10ec-444c-ba22-6f678f7f079e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:06.694215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c5f4ad7e-10ec-444c-ba22-6f678f7f079e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:06.695104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c5f4ad7e-10ec-444c-ba22-6f678f7f079e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:06.696589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c5f4ad7e-10ec-444c-ba22-6f678f7f079e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:06.698394 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c5f4ad7e-10ec-444c-ba22-6f678f7f079e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:06.944293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c758ceeb-aa5f-4225-b7a0-1be2277d571c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:06.955667 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c758ceeb-aa5f-4225-b7a0-1be2277d571c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.647647 Apr 16 16:51:06.968032 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 79/181] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:06 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:06.974023 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-60c54171-29da-4307-8d61-4475474f2160 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:06.975385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-60c54171-29da-4307-8d61-4475474f2160 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:06.984144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60c54171-29da-4307-8d61-4475474f2160 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:06.984932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60c54171-29da-4307-8d61-4475474f2160 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:06.985990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60c54171-29da-4307-8d61-4475474f2160 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:06.986733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60c54171-29da-4307-8d61-4475474f2160 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:07.169920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-60c54171-29da-4307-8d61-4475474f2160 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 14 microversion: 2.1 time: 0.200034 Apr 16 16:51:07.170808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 80/182] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:06 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:51:07.177495 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5095f1a3-f0ca-472a-bd8b-f82e164d3f01 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:07.178842 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5095f1a3-f0ca-472a-bd8b-f82e164d3f01 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:07.188548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5095f1a3-f0ca-472a-bd8b-f82e164d3f01 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:07.193257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5095f1a3-f0ca-472a-bd8b-f82e164d3f01 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:07.193257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5095f1a3-f0ca-472a-bd8b-f82e164d3f01 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:07.193257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5095f1a3-f0ca-472a-bd8b-f82e164d3f01 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:07.312589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c5f4ad7e-10ec-444c-ba22-6f678f7f079e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:07.325620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c5f4ad7e-10ec-444c-ba22-6f678f7f079e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1322 microversion: 2.1 time: 0.658155 Apr 16 16:51:07.326706 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 103/183] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:06 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:07.344399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5095f1a3-f0ca-472a-bd8b-f82e164d3f01 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 14 microversion: 2.20 time: 0.168630 Apr 16 16:51:07.345401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 81/184] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:07 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:07.684522 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2416c99f-e017-4363-90b7-4a012d41e8a2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:07.685194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2416c99f-e017-4363-90b7-4a012d41e8a2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:07.694021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2416c99f-e017-4363-90b7-4a012d41e8a2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:07.695397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2416c99f-e017-4363-90b7-4a012d41e8a2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:07.696446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2416c99f-e017-4363-90b7-4a012d41e8a2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:07.697072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2416c99f-e017-4363-90b7-4a012d41e8a2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:07.980439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8b5f080c-8d6f-40c2-9e2f-bd97efa758c7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:07.981650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8b5f080c-8d6f-40c2-9e2f-bd97efa758c7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:07.996101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b5f080c-8d6f-40c2-9e2f-bd97efa758c7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:07.997390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b5f080c-8d6f-40c2-9e2f-bd97efa758c7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:07.998433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b5f080c-8d6f-40c2-9e2f-bd97efa758c7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:07.999084 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b5f080c-8d6f-40c2-9e2f-bd97efa758c7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:08.899246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2416c99f-e017-4363-90b7-4a012d41e8a2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:08.912092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2416c99f-e017-4363-90b7-4a012d41e8a2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1318 microversion: 2.1 time: 1.232272 Apr 16 16:51:08.923736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 104/185] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:07 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1318 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:08.931250 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8123c935-88b3-437a-8cfb-db92286c0d75 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:08.932661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8123c935-88b3-437a-8cfb-db92286c0d75 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:08.944230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8123c935-88b3-437a-8cfb-db92286c0d75 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:08.945223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8123c935-88b3-437a-8cfb-db92286c0d75 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:08.946338 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8123c935-88b3-437a-8cfb-db92286c0d75 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:08.947043 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8123c935-88b3-437a-8cfb-db92286c0d75 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:09.031313 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8b5f080c-8d6f-40c2-9e2f-bd97efa758c7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:09.052807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8b5f080c-8d6f-40c2-9e2f-bd97efa758c7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 1.080309 Apr 16 16:51:09.062679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 82/186] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:07 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:09.062679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9fcbceea-ccaf-485b-a3f3-5b69c8c6b52e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:09.062679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9fcbceea-ccaf-485b-a3f3-5b69c8c6b52e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:09.082539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9fcbceea-ccaf-485b-a3f3-5b69c8c6b52e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:09.082788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9fcbceea-ccaf-485b-a3f3-5b69c8c6b52e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:09.083560 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9fcbceea-ccaf-485b-a3f3-5b69c8c6b52e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:09.084036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9fcbceea-ccaf-485b-a3f3-5b69c8c6b52e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:09.096578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8123c935-88b3-437a-8cfb-db92286c0d75 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 14 microversion: 2.1 time: 0.170856 Apr 16 16:51:09.100072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 105/187] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:08 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:51:09.103603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b623ad27-12b0-4273-bd61-0584ba0ed6a3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:09.108747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b623ad27-12b0-4273-bd61-0584ba0ed6a3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:09.137026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b623ad27-12b0-4273-bd61-0584ba0ed6a3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:09.138172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b623ad27-12b0-4273-bd61-0584ba0ed6a3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:09.138422 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b623ad27-12b0-4273-bd61-0584ba0ed6a3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:09.138866 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b623ad27-12b0-4273-bd61-0584ba0ed6a3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:09.341366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b623ad27-12b0-4273-bd61-0584ba0ed6a3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 14 microversion: 2.20 time: 0.241795 Apr 16 16:51:09.342235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 106/188] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:09 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 14 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:09.350249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-7d68cb36-82ea-4ce8-818e-12c0525895bb req-e54a54c4-01f4-442b-8b7d-2d8cf71fdd91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6362be-f2e6-4f47-ae72-f6f8b12063dd", "name": "network-vif-plugged", "status": "completed", "tag": "d1974541-0b41-4461-a761-f565ef4eb7b8"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:09.353089 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:51:09.353089 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:51:09.366170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-7d68cb36-82ea-4ce8-818e-12c0525895bb req-e54a54c4-01f4-442b-8b7d-2d8cf71fdd91 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:09.366716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-7d68cb36-82ea-4ce8-818e-12c0525895bb req-e54a54c4-01f4-442b-8b7d-2d8cf71fdd91 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:09.408878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-7d68cb36-82ea-4ce8-818e-12c0525895bb req-e54a54c4-01f4-442b-8b7d-2d8cf71fdd91 service nova] Creating event network-vif-plugged:d1974541-0b41-4461-a761-f565ef4eb7b8 for instance 9d6362be-f2e6-4f47-ae72-f6f8b12063dd on hv-cinder-73362 Apr 16 16:51:09.417054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-7d68cb36-82ea-4ce8-818e-12c0525895bb req-e54a54c4-01f4-442b-8b7d-2d8cf71fdd91 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073263 Apr 16 16:51:09.418559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 107/189] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:51:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:09.935036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9fcbceea-ccaf-485b-a3f3-5b69c8c6b52e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:09.936237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0e6c3558-3782-4a72-9808-ba97041a1d99 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:09.937242 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0e6c3558-3782-4a72-9808-ba97041a1d99 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:09.947318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e6c3558-3782-4a72-9808-ba97041a1d99 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:09.947940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e6c3558-3782-4a72-9808-ba97041a1d99 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:09.948846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e6c3558-3782-4a72-9808-ba97041a1d99 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:09.949406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e6c3558-3782-4a72-9808-ba97041a1d99 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:09.955835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9fcbceea-ccaf-485b-a3f3-5b69c8c6b52e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1322 microversion: 2.1 time: 0.900615 Apr 16 16:51:09.956778 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 83/190] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:09 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1322 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:10.069897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-feb175bd-7112-4e11-b798-d1d45f142f89 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:10.070778 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-feb175bd-7112-4e11-b798-d1d45f142f89 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:10.079405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-feb175bd-7112-4e11-b798-d1d45f142f89 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:10.080150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-feb175bd-7112-4e11-b798-d1d45f142f89 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:10.081162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-feb175bd-7112-4e11-b798-d1d45f142f89 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:10.082489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-feb175bd-7112-4e11-b798-d1d45f142f89 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:10.798055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0e6c3558-3782-4a72-9808-ba97041a1d99 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:10.812185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0e6c3558-3782-4a72-9808-ba97041a1d99 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1318 microversion: 2.1 time: 0.880888 Apr 16 16:51:10.812908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 108/191] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:09 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1318 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:10.821626 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-001b8590-92a3-46bb-8dcc-c56b7baa321d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:10.824026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-001b8590-92a3-46bb-8dcc-c56b7baa321d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:10.834216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-001b8590-92a3-46bb-8dcc-c56b7baa321d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:10.835169 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-001b8590-92a3-46bb-8dcc-c56b7baa321d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:10.836202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-001b8590-92a3-46bb-8dcc-c56b7baa321d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:10.837046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-001b8590-92a3-46bb-8dcc-c56b7baa321d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:10.929374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-feb175bd-7112-4e11-b798-d1d45f142f89 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:10.945964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-feb175bd-7112-4e11-b798-d1d45f142f89 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.878967 Apr 16 16:51:10.946620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 84/192] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:10 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:10.961840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cc612115-78fb-47db-b2bd-eb9ccdcf40fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:10.963402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cc612115-78fb-47db-b2bd-eb9ccdcf40fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:10.982054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc612115-78fb-47db-b2bd-eb9ccdcf40fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:10.982931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc612115-78fb-47db-b2bd-eb9ccdcf40fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:10.987242 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc612115-78fb-47db-b2bd-eb9ccdcf40fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:10.987742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc612115-78fb-47db-b2bd-eb9ccdcf40fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:11.031353 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-001b8590-92a3-46bb-8dcc-c56b7baa321d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 14 microversion: 2.1 time: 0.216516 Apr 16 16:51:11.031843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 109/193] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:10 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:51:11.039938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-51f42f29-3783-48c3-8bce-6f2b8ddf37d4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:11.040714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-51f42f29-3783-48c3-8bce-6f2b8ddf37d4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:11.067766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-51f42f29-3783-48c3-8bce-6f2b8ddf37d4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:11.068617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-51f42f29-3783-48c3-8bce-6f2b8ddf37d4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:11.069847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-51f42f29-3783-48c3-8bce-6f2b8ddf37d4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:11.070555 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-51f42f29-3783-48c3-8bce-6f2b8ddf37d4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:11.203621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cc612115-78fb-47db-b2bd-eb9ccdcf40fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 11454 microversion: 2.20 time: 0.254023 Apr 16 16:51:11.204431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 85/194] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:10 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 11454 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:11.402931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-454a6531-c218-406f-9714-c6dc631f1ed4 req-d39d293a-58cb-4487-a89c-937ab1d5d18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28a807c-7fe0-43e9-90d4-afbc06b99029", "tag": "da606ecb-e349-4795-bddb-3c2db704b112"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:11.404992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:51:11.404992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:51:11.416822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-454a6531-c218-406f-9714-c6dc631f1ed4 req-d39d293a-58cb-4487-a89c-937ab1d5d18a service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:11.417918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-454a6531-c218-406f-9714-c6dc631f1ed4 req-d39d293a-58cb-4487-a89c-937ab1d5d18a service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:11.443397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-454a6531-c218-406f-9714-c6dc631f1ed4 req-d39d293a-58cb-4487-a89c-937ab1d5d18a service nova] Creating event network-changed:da606ecb-e349-4795-bddb-3c2db704b112 for instance d28a807c-7fe0-43e9-90d4-afbc06b99029 on hv-cinder-73362 Apr 16 16:51:11.449541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-454a6531-c218-406f-9714-c6dc631f1ed4 req-d39d293a-58cb-4487-a89c-937ab1d5d18a service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052742 Apr 16 16:51:11.453632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 86/195] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:51:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:11.770459 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-51f42f29-3783-48c3-8bce-6f2b8ddf37d4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:11.786793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-51f42f29-3783-48c3-8bce-6f2b8ddf37d4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1322 microversion: 2.1 time: 0.753552 Apr 16 16:51:11.788783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 110/196] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:11 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1322 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:11.831725 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-829438da-60ab-42ba-b090-ddd30d123a67 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:11.833828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-829438da-60ab-42ba-b090-ddd30d123a67 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:11.861714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-829438da-60ab-42ba-b090-ddd30d123a67 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:11.862186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-829438da-60ab-42ba-b090-ddd30d123a67 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:11.863141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-829438da-60ab-42ba-b090-ddd30d123a67 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:11.863644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-829438da-60ab-42ba-b090-ddd30d123a67 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:11.964196 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8b796e05-c9c1-4805-8482-33654ed8fe5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:11.965842 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8b796e05-c9c1-4805-8482-33654ed8fe5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:11.980186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b796e05-c9c1-4805-8482-33654ed8fe5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:11.980945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b796e05-c9c1-4805-8482-33654ed8fe5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:11.984928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b796e05-c9c1-4805-8482-33654ed8fe5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:11.985677 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b796e05-c9c1-4805-8482-33654ed8fe5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:12.524840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-829438da-60ab-42ba-b090-ddd30d123a67 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:12.545583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-829438da-60ab-42ba-b090-ddd30d123a67 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1318 microversion: 2.1 time: 0.718906 Apr 16 16:51:12.561477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 87/197] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:11 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:12.582182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1b375454-0f17-487c-ad34-b877ed62cc0f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:12.583519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1b375454-0f17-487c-ad34-b877ed62cc0f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:12.604107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b375454-0f17-487c-ad34-b877ed62cc0f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:12.604617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b375454-0f17-487c-ad34-b877ed62cc0f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:12.605473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b375454-0f17-487c-ad34-b877ed62cc0f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:12.605958 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b375454-0f17-487c-ad34-b877ed62cc0f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:12.672910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8b796e05-c9c1-4805-8482-33654ed8fe5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:12.684722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8b796e05-c9c1-4805-8482-33654ed8fe5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.724314 Apr 16 16:51:12.686025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 111/198] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:11 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:12.727063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dea47e5a-d7d4-4cba-9143-ddf64abb0b1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:12.733765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dea47e5a-d7d4-4cba-9143-ddf64abb0b1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:12.762601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dea47e5a-d7d4-4cba-9143-ddf64abb0b1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:12.763122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dea47e5a-d7d4-4cba-9143-ddf64abb0b1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:12.763981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dea47e5a-d7d4-4cba-9143-ddf64abb0b1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:12.764470 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dea47e5a-d7d4-4cba-9143-ddf64abb0b1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:12.856084 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1b375454-0f17-487c-ad34-b877ed62cc0f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 14 microversion: 2.1 time: 0.294470 Apr 16 16:51:12.857520 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 88/199] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:12 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 14 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:51:12.864843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1e599292-32b7-4266-93cc-7bb70c8d6317 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:12.865596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1e599292-32b7-4266-93cc-7bb70c8d6317 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:12.901591 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e599292-32b7-4266-93cc-7bb70c8d6317 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:12.902528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e599292-32b7-4266-93cc-7bb70c8d6317 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:12.903424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e599292-32b7-4266-93cc-7bb70c8d6317 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:12.914194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e599292-32b7-4266-93cc-7bb70c8d6317 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:12.975740 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dea47e5a-d7d4-4cba-9143-ddf64abb0b1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 17092 microversion: 2.20 time: 0.269294 Apr 16 16:51:12.981867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 112/200] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:12 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 17092 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:13.452835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1e599292-32b7-4266-93cc-7bb70c8d6317 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:13.465438 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1e599292-32b7-4266-93cc-7bb70c8d6317 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1511 microversion: 2.1 time: 0.606044 Apr 16 16:51:13.471730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 89/201] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:12 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1511 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:13.490688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-352e6090-e716-4e6d-9475-115ffef301f6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2ed96d2-05d8-4274-bd87-d6e1241cea76"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:13.491914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-352e6090-e716-4e6d-9475-115ffef301f6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:13.503181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-352e6090-e716-4e6d-9475-115ffef301f6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:13.504514 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-352e6090-e716-4e6d-9475-115ffef301f6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:13.505374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-352e6090-e716-4e6d-9475-115ffef301f6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:13.506752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-352e6090-e716-4e6d-9475-115ffef301f6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:13.569915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-aac6b98e-3a67-4b7f-9f6e-fb80aa86c6d8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:13.570637 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-aac6b98e-3a67-4b7f-9f6e-fb80aa86c6d8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:13.589954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aac6b98e-3a67-4b7f-9f6e-fb80aa86c6d8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:13.590665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aac6b98e-3a67-4b7f-9f6e-fb80aa86c6d8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:13.591539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aac6b98e-3a67-4b7f-9f6e-fb80aa86c6d8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:13.592036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aac6b98e-3a67-4b7f-9f6e-fb80aa86c6d8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:13.825357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-352e6090-e716-4e6d-9475-115ffef301f6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] HTTP exception thrown: Invalid volume: volume c2ed96d2-05d8-4274-bd87-d6e1241cea76 is already attached to instances: ce1414be-e673-4c5e-b491-990d5eabe83f Apr 16 16:51:13.826025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-352e6090-e716-4e6d-9475-115ffef301f6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Returning 400 to user: Invalid volume: volume c2ed96d2-05d8-4274-bd87-d6e1241cea76 is already attached to instances: ce1414be-e673-4c5e-b491-990d5eabe83f {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:51:13.826964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-352e6090-e716-4e6d-9475-115ffef301f6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "POST /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.341751 Apr 16 16:51:13.827578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 113/202] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:51:13 2021] POST /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd/os-volume_attachments => generated 174 bytes in 343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 16:51:13.836334 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f60d1a64-4199-4f48-ad1d-71bb816136f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:13.836996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f60d1a64-4199-4f48-ad1d-71bb816136f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:13.858365 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f60d1a64-4199-4f48-ad1d-71bb816136f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:13.858834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f60d1a64-4199-4f48-ad1d-71bb816136f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:13.859684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f60d1a64-4199-4f48-ad1d-71bb816136f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:13.860171 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f60d1a64-4199-4f48-ad1d-71bb816136f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:14.598880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-aac6b98e-3a67-4b7f-9f6e-fb80aa86c6d8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:14.616021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-aac6b98e-3a67-4b7f-9f6e-fb80aa86c6d8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1318 microversion: 2.1 time: 1.051421 Apr 16 16:51:14.616656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 90/203] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:13 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1318 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:14.631302 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-843ed587-ef9c-45ed-9ea8-547d8ec31529 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:14.636300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-843ed587-ef9c-45ed-9ea8-547d8ec31529 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:14.646646 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-843ed587-ef9c-45ed-9ea8-547d8ec31529 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:14.647386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-843ed587-ef9c-45ed-9ea8-547d8ec31529 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:14.648390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-843ed587-ef9c-45ed-9ea8-547d8ec31529 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:14.649025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-843ed587-ef9c-45ed-9ea8-547d8ec31529 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:14.776281 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f60d1a64-4199-4f48-ad1d-71bb816136f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:14.789244 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f60d1a64-4199-4f48-ad1d-71bb816136f6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.960546 Apr 16 16:51:14.789863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 114/204] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:13 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:14.795836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b625aaa0-2ce3-44bb-8925-06fdbdb8c5c0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:14.797331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b625aaa0-2ce3-44bb-8925-06fdbdb8c5c0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:14.809601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b625aaa0-2ce3-44bb-8925-06fdbdb8c5c0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:14.809601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b625aaa0-2ce3-44bb-8925-06fdbdb8c5c0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:14.809601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b625aaa0-2ce3-44bb-8925-06fdbdb8c5c0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:14.809876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b625aaa0-2ce3-44bb-8925-06fdbdb8c5c0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:14.819085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-843ed587-ef9c-45ed-9ea8-547d8ec31529 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 10009 microversion: 2.1 time: 0.197591 Apr 16 16:51:14.819964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 91/205] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:14 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 10009 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:14.833127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e1e2843d-9a31-46c2-a002-03e0a33cdf0f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:14.842521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e1e2843d-9a31-46c2-a002-03e0a33cdf0f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:14.860617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1e2843d-9a31-46c2-a002-03e0a33cdf0f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:14.865509 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1e2843d-9a31-46c2-a002-03e0a33cdf0f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:14.866761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1e2843d-9a31-46c2-a002-03e0a33cdf0f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:14.867410 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1e2843d-9a31-46c2-a002-03e0a33cdf0f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:14.965991 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b625aaa0-2ce3-44bb-8925-06fdbdb8c5c0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 18509 microversion: 2.20 time: 0.174271 Apr 16 16:51:14.967445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 115/206] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:14 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 18509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:15.152136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-e1e2843d-9a31-46c2-a002-03e0a33cdf0f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lazy-loading 'services' on Instance uuid ce1414be-e673-4c5e-b491-990d5eabe83f {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:51:15.454012 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e1e2843d-9a31-46c2-a002-03e0a33cdf0f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "DELETE /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f/os-volume_attachments/c2ed96d2-05d8-4274-bd87-d6e1241cea76" status: 202 len: 0 microversion: 2.1 time: 0.628576 Apr 16 16:51:15.459737 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 92/207] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 16:51:14 2021] DELETE /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f/os-volume_attachments/c2ed96d2-05d8-4274-bd87-d6e1241cea76 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:15.637719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-94ff553a-c18a-47ea-adf5-5bcdaf7a291c tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:15.639265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-94ff553a-c18a-47ea-adf5-5bcdaf7a291c tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:15.672463 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-94ff553a-c18a-47ea-adf5-5bcdaf7a291c tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:15.676551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-94ff553a-c18a-47ea-adf5-5bcdaf7a291c tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:15.678273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-94ff553a-c18a-47ea-adf5-5bcdaf7a291c tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:15.680663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-94ff553a-c18a-47ea-adf5-5bcdaf7a291c tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:15.809946 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bb29654b-168c-41d2-9ae0-3ba9f921e556 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:15.810924 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bb29654b-168c-41d2-9ae0-3ba9f921e556 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:15.827584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bb29654b-168c-41d2-9ae0-3ba9f921e556 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:15.833990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bb29654b-168c-41d2-9ae0-3ba9f921e556 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:15.835115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bb29654b-168c-41d2-9ae0-3ba9f921e556 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:15.835762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bb29654b-168c-41d2-9ae0-3ba9f921e556 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:16.108041 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-94ff553a-c18a-47ea-adf5-5bcdaf7a291c tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:16.126863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-94ff553a-c18a-47ea-adf5-5bcdaf7a291c tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1318 microversion: 2.1 time: 0.494966 Apr 16 16:51:16.138836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 116/208] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:15 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:16.144139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2d7e33b3-d60d-4a14-baf6-4b87b610153a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:16.145150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2d7e33b3-d60d-4a14-baf6-4b87b610153a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:16.155441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d7e33b3-d60d-4a14-baf6-4b87b610153a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:16.155951 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d7e33b3-d60d-4a14-baf6-4b87b610153a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:16.156804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d7e33b3-d60d-4a14-baf6-4b87b610153a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:16.157291 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d7e33b3-d60d-4a14-baf6-4b87b610153a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:16.257340 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bb29654b-168c-41d2-9ae0-3ba9f921e556 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:16.266712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bb29654b-168c-41d2-9ae0-3ba9f921e556 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.462378 Apr 16 16:51:16.267346 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 93/209] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:15 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:16.272727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d02ca585-d706-4eef-b746-87d98a22b3e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:16.273838 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d02ca585-d706-4eef-b746-87d98a22b3e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:16.282176 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d02ca585-d706-4eef-b746-87d98a22b3e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:16.282703 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d02ca585-d706-4eef-b746-87d98a22b3e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:16.283551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d02ca585-d706-4eef-b746-87d98a22b3e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:16.284040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d02ca585-d706-4eef-b746-87d98a22b3e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:16.317929 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2d7e33b3-d60d-4a14-baf6-4b87b610153a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 15064 microversion: 2.1 time: 0.177526 Apr 16 16:51:16.323218 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 117/210] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:16 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 15064 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:16.468644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d02ca585-d706-4eef-b746-87d98a22b3e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 20751 microversion: 2.20 time: 0.199635 Apr 16 16:51:16.476185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 94/211] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:16 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 20751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:17.149118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1094b409-0bb3-4fd0-b31b-5daea27918bc tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:17.151055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1094b409-0bb3-4fd0-b31b-5daea27918bc tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:17.162331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1094b409-0bb3-4fd0-b31b-5daea27918bc tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:17.163076 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1094b409-0bb3-4fd0-b31b-5daea27918bc tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:17.164303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1094b409-0bb3-4fd0-b31b-5daea27918bc tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:17.164952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1094b409-0bb3-4fd0-b31b-5daea27918bc tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:17.287407 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bf3d83cf-ff09-4667-807b-2574372ab217 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:17.288367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bf3d83cf-ff09-4667-807b-2574372ab217 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:17.312661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf3d83cf-ff09-4667-807b-2574372ab217 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:17.313652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf3d83cf-ff09-4667-807b-2574372ab217 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:17.314789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf3d83cf-ff09-4667-807b-2574372ab217 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:17.315442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf3d83cf-ff09-4667-807b-2574372ab217 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:17.526496 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1094b409-0bb3-4fd0-b31b-5daea27918bc tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:17.546069 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1094b409-0bb3-4fd0-b31b-5daea27918bc tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1318 microversion: 2.1 time: 0.404317 Apr 16 16:51:17.548511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 118/212] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:17 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:17.562846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f6b125c9-635f-473f-9dc9-102f514d08c0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:17.564122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f6b125c9-635f-473f-9dc9-102f514d08c0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:17.583938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6b125c9-635f-473f-9dc9-102f514d08c0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:17.585707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6b125c9-635f-473f-9dc9-102f514d08c0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:17.587268 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6b125c9-635f-473f-9dc9-102f514d08c0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:17.589955 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6b125c9-635f-473f-9dc9-102f514d08c0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:17.805975 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f6b125c9-635f-473f-9dc9-102f514d08c0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 17861 microversion: 2.1 time: 0.255557 Apr 16 16:51:17.811123 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 119/213] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:17 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 17861 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:17.819218 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bf3d83cf-ff09-4667-807b-2574372ab217 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:17.823053 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a637f6d3-de75-47e4-b5a0-b6c354fffe1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:17.824349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a637f6d3-de75-47e4-b5a0-b6c354fffe1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:17.830465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bf3d83cf-ff09-4667-807b-2574372ab217 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.549180 Apr 16 16:51:17.831966 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 95/214] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:17 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:17.833900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a637f6d3-de75-47e4-b5a0-b6c354fffe1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:17.834722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a637f6d3-de75-47e4-b5a0-b6c354fffe1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:17.835724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a637f6d3-de75-47e4-b5a0-b6c354fffe1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:17.836351 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a637f6d3-de75-47e4-b5a0-b6c354fffe1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:17.989015 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a637f6d3-de75-47e4-b5a0-b6c354fffe1e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 22534 microversion: 2.20 time: 0.175226 Apr 16 16:51:17.991252 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 120/215] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:17 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 22534 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:18.149841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-357026702", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "networks": [{"uuid": "4b2a2bf5-f241-4566-8a43-225171ec9f91"}]}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:18.239713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] validate_networks() for [('4b2a2bf5-f241-4566-8a43-225171ec9f91', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:51:18.578790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a83fa33b-61eb-4b5e-a7c0-936807e16749 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:18.584599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a83fa33b-61eb-4b5e-a7c0-936807e16749 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:18.608102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a83fa33b-61eb-4b5e-a7c0-936807e16749 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:18.609689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a83fa33b-61eb-4b5e-a7c0-936807e16749 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:18.610837 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a83fa33b-61eb-4b5e-a7c0-936807e16749 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:18.611547 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a83fa33b-61eb-4b5e-a7c0-936807e16749 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:19.069909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a83fa33b-61eb-4b5e-a7c0-936807e16749 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:19.085189 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a83fa33b-61eb-4b5e-a7c0-936807e16749 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1318 microversion: 2.1 time: 0.520451 Apr 16 16:51:19.086601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 121/216] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:18 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:19.093046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-415725a6-f710-4920-8259-51ff6697df88 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:19.094322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:51:19.094814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:51:19.095094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-415725a6-f710-4920-8259-51ff6697df88 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:19.095352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:51:19.095808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:51:19.096264 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:51:19.106526 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-415725a6-f710-4920-8259-51ff6697df88 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:19.107283 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-415725a6-f710-4920-8259-51ff6697df88 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:19.108481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-415725a6-f710-4920-8259-51ff6697df88 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:19.109426 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-415725a6-f710-4920-8259-51ff6697df88 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:19.127887 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:19.129232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:19.131480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:19.132027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:19.195311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Getting quotas for project a46c79620899432c8193a987ece333df. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:51:19.199894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Getting quotas for user 44a48edfa5ca47949ffb787b0d7fe204 and project a46c79620899432c8193a987ece333df. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:51:19.232312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:51:19.234950 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:51:19.235821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-415725a6-f710-4920-8259-51ff6697df88 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 19295 microversion: 2.1 time: 0.147330 Apr 16 16:51:19.240935 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 122/217] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:19 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 19295 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:19.246652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a82d2414-719b-439e-aa12-8369448ca1a4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:19.247430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a82d2414-719b-439e-aa12-8369448ca1a4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:19.256791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a82d2414-719b-439e-aa12-8369448ca1a4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:19.257305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a82d2414-719b-439e-aa12-8369448ca1a4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:19.258171 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a82d2414-719b-439e-aa12-8369448ca1a4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:19.258751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a82d2414-719b-439e-aa12-8369448ca1a4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:19.311330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-85797147-a433-4f7e-b76f-5172b0d22db4 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.166865 Apr 16 16:51:19.319211 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 96/218] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:51:18 2021] POST /compute/v2.1/servers => generated 382 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:51:19.326774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-be693238-0462-45ff-a8c8-b6686448e49b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:19.327934 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-be693238-0462-45ff-a8c8-b6686448e49b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:19.344607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be693238-0462-45ff-a8c8-b6686448e49b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:19.345121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be693238-0462-45ff-a8c8-b6686448e49b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:19.345991 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be693238-0462-45ff-a8c8-b6686448e49b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:19.346544 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be693238-0462-45ff-a8c8-b6686448e49b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:19.520600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-be693238-0462-45ff-a8c8-b6686448e49b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 23785 microversion: 2.20 time: 0.198255 Apr 16 16:51:19.521436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 97/219] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:19 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 23785 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:19.540869 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5a1c3419-a16b-4072-84e4-45ef35709dd7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:19.541639 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5a1c3419-a16b-4072-84e4-45ef35709dd7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:19.750069 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a82d2414-719b-439e-aa12-8369448ca1a4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:19.764234 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5a1c3419-a16b-4072-84e4-45ef35709dd7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:19.767032 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a82d2414-719b-439e-aa12-8369448ca1a4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.524642 Apr 16 16:51:19.768165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 123/220] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:19 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:19.793553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5a1c3419-a16b-4072-84e4-45ef35709dd7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1221 microversion: 2.1 time: 0.270511 Apr 16 16:51:19.794177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 98/221] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:19 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1221 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:20.105615 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e92f5b77-13e4-478e-a56f-41709113853f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:20.106588 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e92f5b77-13e4-478e-a56f-41709113853f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:20.119882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e92f5b77-13e4-478e-a56f-41709113853f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:20.120395 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e92f5b77-13e4-478e-a56f-41709113853f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:20.121436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e92f5b77-13e4-478e-a56f-41709113853f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:20.122100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e92f5b77-13e4-478e-a56f-41709113853f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:20.248969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e687ecf2-d3a9-41c0-9866-3937397c9bc4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:20.250016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e687ecf2-d3a9-41c0-9866-3937397c9bc4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:20.273762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e687ecf2-d3a9-41c0-9866-3937397c9bc4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:20.274420 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e687ecf2-d3a9-41c0-9866-3937397c9bc4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:20.275564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e687ecf2-d3a9-41c0-9866-3937397c9bc4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:20.278405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e687ecf2-d3a9-41c0-9866-3937397c9bc4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:20.463979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e92f5b77-13e4-478e-a56f-41709113853f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:20.475992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e92f5b77-13e4-478e-a56f-41709113853f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1318 microversion: 2.1 time: 0.375288 Apr 16 16:51:20.478398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 124/222] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:20 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:20.517616 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e687ecf2-d3a9-41c0-9866-3937397c9bc4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 20997 microversion: 2.1 time: 0.269547 Apr 16 16:51:20.518632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 99/223] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:20 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 20997 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:51:20.536381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f07ba130-d88c-4425-bbc3-8028a1807579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:20.537632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f07ba130-d88c-4425-bbc3-8028a1807579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:20.558242 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f07ba130-d88c-4425-bbc3-8028a1807579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:20.563675 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f07ba130-d88c-4425-bbc3-8028a1807579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:20.564713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f07ba130-d88c-4425-bbc3-8028a1807579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:20.565223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f07ba130-d88c-4425-bbc3-8028a1807579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:20.742039 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f07ba130-d88c-4425-bbc3-8028a1807579 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 24514 microversion: 2.20 time: 0.212434 Apr 16 16:51:20.743197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 125/224] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:20 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 24514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:20.790640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bc407d2e-fa7e-46a1-8717-98bd89d9d382 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:20.791701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bc407d2e-fa7e-46a1-8717-98bd89d9d382 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:20.801923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bc407d2e-fa7e-46a1-8717-98bd89d9d382 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:20.802732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bc407d2e-fa7e-46a1-8717-98bd89d9d382 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:20.804974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bc407d2e-fa7e-46a1-8717-98bd89d9d382 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:20.805610 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bc407d2e-fa7e-46a1-8717-98bd89d9d382 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:20.813953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f2748ef9-33bc-42e2-bf98-e155365d4f6e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:20.816227 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f2748ef9-33bc-42e2-bf98-e155365d4f6e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:20.829125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f2748ef9-33bc-42e2-bf98-e155365d4f6e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:20.830233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f2748ef9-33bc-42e2-bf98-e155365d4f6e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:20.837180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f2748ef9-33bc-42e2-bf98-e155365d4f6e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:20.838246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f2748ef9-33bc-42e2-bf98-e155365d4f6e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:21.079913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f2748ef9-33bc-42e2-bf98-e155365d4f6e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:21.092670 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f2748ef9-33bc-42e2-bf98-e155365d4f6e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1273 microversion: 2.1 time: 0.283784 Apr 16 16:51:21.093316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 126/225] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:20 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:21.237699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bc407d2e-fa7e-46a1-8717-98bd89d9d382 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:21.252387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bc407d2e-fa7e-46a1-8717-98bd89d9d382 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.467394 Apr 16 16:51:21.257398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 100/226] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:20 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:21.497353 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f55a832b-9d7f-4c6b-a46f-1afd68462784 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:21.498038 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f55a832b-9d7f-4c6b-a46f-1afd68462784 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:21.514912 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f55a832b-9d7f-4c6b-a46f-1afd68462784 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:21.515410 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f55a832b-9d7f-4c6b-a46f-1afd68462784 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:21.516252 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f55a832b-9d7f-4c6b-a46f-1afd68462784 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:21.516898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f55a832b-9d7f-4c6b-a46f-1afd68462784 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:21.530841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8ca835ff-97d4-4ab7-94f7-02105e27e5ff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:21.531887 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8ca835ff-97d4-4ab7-94f7-02105e27e5ff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:21.554231 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8ca835ff-97d4-4ab7-94f7-02105e27e5ff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:21.554759 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8ca835ff-97d4-4ab7-94f7-02105e27e5ff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:21.555603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8ca835ff-97d4-4ab7-94f7-02105e27e5ff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:21.556086 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8ca835ff-97d4-4ab7-94f7-02105e27e5ff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:21.733239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8ca835ff-97d4-4ab7-94f7-02105e27e5ff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 22439 microversion: 2.1 time: 0.206542 Apr 16 16:51:21.734479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 101/227] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:21 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 22439 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:21.754984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9dd4d799-2be0-42a4-a07b-9a84af0ecaa5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:21.756467 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9dd4d799-2be0-42a4-a07b-9a84af0ecaa5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:21.772717 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9dd4d799-2be0-42a4-a07b-9a84af0ecaa5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:21.774694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9dd4d799-2be0-42a4-a07b-9a84af0ecaa5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:21.777024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9dd4d799-2be0-42a4-a07b-9a84af0ecaa5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:21.779746 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9dd4d799-2be0-42a4-a07b-9a84af0ecaa5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:21.955890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9dd4d799-2be0-42a4-a07b-9a84af0ecaa5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 25414 microversion: 2.20 time: 0.205954 Apr 16 16:51:21.958961 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 102/228] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:21 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 25414 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:51:22.113790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-35124e27-2dff-4725-9a72-8a69176016b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:22.114958 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-35124e27-2dff-4725-9a72-8a69176016b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:22.133743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-35124e27-2dff-4725-9a72-8a69176016b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:22.143173 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-35124e27-2dff-4725-9a72-8a69176016b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:22.144543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-35124e27-2dff-4725-9a72-8a69176016b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:22.145377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-35124e27-2dff-4725-9a72-8a69176016b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:22.774271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-35124e27-2dff-4725-9a72-8a69176016b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:22.789734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-35124e27-2dff-4725-9a72-8a69176016b6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1279 microversion: 2.1 time: 0.681568 Apr 16 16:51:22.790994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 103/229] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:22 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1279 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:22.795839 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dbec33cd-57fa-4c48-a03c-a3a6551a4fe8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:22.805197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dbec33cd-57fa-4c48-a03c-a3a6551a4fe8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:22.821444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dbec33cd-57fa-4c48-a03c-a3a6551a4fe8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:22.822207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dbec33cd-57fa-4c48-a03c-a3a6551a4fe8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:22.823293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dbec33cd-57fa-4c48-a03c-a3a6551a4fe8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:22.823938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dbec33cd-57fa-4c48-a03c-a3a6551a4fe8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:23.155609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f55a832b-9d7f-4c6b-a46f-1afd68462784 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:23.171013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f55a832b-9d7f-4c6b-a46f-1afd68462784 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1318 microversion: 2.1 time: 1.677600 Apr 16 16:51:23.172206 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 127/230] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:21 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1318 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:23.189097 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3f9d52e5-f3db-4edc-93f5-c97e39b97eb0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:23.190148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3f9d52e5-f3db-4edc-93f5-c97e39b97eb0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:23.200459 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3f9d52e5-f3db-4edc-93f5-c97e39b97eb0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:23.209175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3f9d52e5-f3db-4edc-93f5-c97e39b97eb0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:23.210424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3f9d52e5-f3db-4edc-93f5-c97e39b97eb0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:23.211136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3f9d52e5-f3db-4edc-93f5-c97e39b97eb0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:23.393479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3f9d52e5-f3db-4edc-93f5-c97e39b97eb0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 23799 microversion: 2.1 time: 0.219516 Apr 16 16:51:23.394542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 128/231] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:23 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 23799 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:23.400976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-909a15d9-74d1-429a-b0e1-ba59c04fbbf3 req-4591585d-11ca-4cb3-94bc-fcc536df3a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28a807c-7fe0-43e9-90d4-afbc06b99029", "name": "network-vif-plugged", "status": "completed", "tag": "da606ecb-e349-4795-bddb-3c2db704b112"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:23.406722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:51:23.406722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:51:23.420752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-909a15d9-74d1-429a-b0e1-ba59c04fbbf3 req-4591585d-11ca-4cb3-94bc-fcc536df3a39 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:23.421642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-909a15d9-74d1-429a-b0e1-ba59c04fbbf3 req-4591585d-11ca-4cb3-94bc-fcc536df3a39 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:23.444783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-909a15d9-74d1-429a-b0e1-ba59c04fbbf3 req-4591585d-11ca-4cb3-94bc-fcc536df3a39 service nova] Creating event network-vif-plugged:da606ecb-e349-4795-bddb-3c2db704b112 for instance d28a807c-7fe0-43e9-90d4-afbc06b99029 on hv-cinder-73362 Apr 16 16:51:23.451030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-909a15d9-74d1-429a-b0e1-ba59c04fbbf3 req-4591585d-11ca-4cb3-94bc-fcc536df3a39 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054286 Apr 16 16:51:23.452366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 129/232] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:23.458547 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c4a3da7f-fdcb-4ee7-b0af-fd1c9d3b8161 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:23.460092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c4a3da7f-fdcb-4ee7-b0af-fd1c9d3b8161 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:23.472225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4a3da7f-fdcb-4ee7-b0af-fd1c9d3b8161 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:23.472915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4a3da7f-fdcb-4ee7-b0af-fd1c9d3b8161 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:23.473937 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4a3da7f-fdcb-4ee7-b0af-fd1c9d3b8161 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:23.474622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4a3da7f-fdcb-4ee7-b0af-fd1c9d3b8161 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:23.475307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dbec33cd-57fa-4c48-a03c-a3a6551a4fe8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:23.494334 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dbec33cd-57fa-4c48-a03c-a3a6551a4fe8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.702071 Apr 16 16:51:23.497968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 104/233] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:22 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:23.623857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c4a3da7f-fdcb-4ee7-b0af-fd1c9d3b8161 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 26666 microversion: 2.20 time: 0.169637 Apr 16 16:51:23.624951 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 130/234] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:23 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 26666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:23.812344 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-282aa9ce-9a5b-48ad-9542-8f19feacbbb9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:23.814010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-282aa9ce-9a5b-48ad-9542-8f19feacbbb9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:23.824904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-282aa9ce-9a5b-48ad-9542-8f19feacbbb9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:23.825658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-282aa9ce-9a5b-48ad-9542-8f19feacbbb9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:23.826836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-282aa9ce-9a5b-48ad-9542-8f19feacbbb9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:23.827766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-282aa9ce-9a5b-48ad-9542-8f19feacbbb9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:24.190267 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-138b6fde-cd30-4778-821e-e2f5dcdc6077 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:24.191224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-138b6fde-cd30-4778-821e-e2f5dcdc6077 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:24.216829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-138b6fde-cd30-4778-821e-e2f5dcdc6077 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:24.217346 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-138b6fde-cd30-4778-821e-e2f5dcdc6077 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:24.218210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-138b6fde-cd30-4778-821e-e2f5dcdc6077 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:24.218738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-138b6fde-cd30-4778-821e-e2f5dcdc6077 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:25.116021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-282aa9ce-9a5b-48ad-9542-8f19feacbbb9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:25.128281 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-282aa9ce-9a5b-48ad-9542-8f19feacbbb9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1321 microversion: 2.1 time: 1.321116 Apr 16 16:51:25.129428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 105/235] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:23 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1321 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:25.135738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c47803c5-cee2-4f05-bb2f-ce3f55d72025 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:25.137766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c47803c5-cee2-4f05-bb2f-ce3f55d72025 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:25.152235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c47803c5-cee2-4f05-bb2f-ce3f55d72025 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:25.153335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c47803c5-cee2-4f05-bb2f-ce3f55d72025 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:25.154520 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c47803c5-cee2-4f05-bb2f-ce3f55d72025 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:25.155572 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c47803c5-cee2-4f05-bb2f-ce3f55d72025 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:25.202380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-138b6fde-cd30-4778-821e-e2f5dcdc6077 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:25.217797 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-138b6fde-cd30-4778-821e-e2f5dcdc6077 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1318 microversion: 2.1 time: 1.032259 Apr 16 16:51:25.224524 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 131/236] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:24 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1318 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:25.237025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0fa16fee-aac1-4961-86a3-45197ca16001 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:25.237769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0fa16fee-aac1-4961-86a3-45197ca16001 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:25.253119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0fa16fee-aac1-4961-86a3-45197ca16001 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:25.255003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0fa16fee-aac1-4961-86a3-45197ca16001 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:25.256521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0fa16fee-aac1-4961-86a3-45197ca16001 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:25.257151 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0fa16fee-aac1-4961-86a3-45197ca16001 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:25.317790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c47803c5-cee2-4f05-bb2f-ce3f55d72025 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 25272 microversion: 2.1 time: 0.186691 Apr 16 16:51:25.318965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 106/237] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:25 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 25272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:25.341027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-036882d7-5311-46b8-adde-99d9564bba50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:25.343440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-036882d7-5311-46b8-adde-99d9564bba50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:25.357827 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-036882d7-5311-46b8-adde-99d9564bba50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:25.358442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-036882d7-5311-46b8-adde-99d9564bba50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:25.359323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-036882d7-5311-46b8-adde-99d9564bba50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:25.360078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-036882d7-5311-46b8-adde-99d9564bba50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:25.508344 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-036882d7-5311-46b8-adde-99d9564bba50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 27426 microversion: 2.20 time: 0.178213 Apr 16 16:51:25.511417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 107/238] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:25 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 27426 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:25.712447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0fa16fee-aac1-4961-86a3-45197ca16001 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:25.743514 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0fa16fee-aac1-4961-86a3-45197ca16001 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.517524 Apr 16 16:51:25.764841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 132/239] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:25 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:26.147542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-581d1e66-3edf-4633-979b-1cafa2b4e62d req-d96ccaa5-6fef-457d-a4e3-86ca182b280e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb60f26-2b88-48af-81dd-927c66dc681f", "tag": "23369559-a855-4cb3-8ac2-eac8b5506e56"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:26.147993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1eff58f5-b660-45b7-a756-f3fd8e38cb53 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:26.148565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1eff58f5-b660-45b7-a756-f3fd8e38cb53 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:26.149237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:51:26.149237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:51:26.164287 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-581d1e66-3edf-4633-979b-1cafa2b4e62d req-d96ccaa5-6fef-457d-a4e3-86ca182b280e service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:26.164980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-581d1e66-3edf-4633-979b-1cafa2b4e62d req-d96ccaa5-6fef-457d-a4e3-86ca182b280e service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:26.169213 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1eff58f5-b660-45b7-a756-f3fd8e38cb53 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:26.169841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1eff58f5-b660-45b7-a756-f3fd8e38cb53 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:26.170846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1eff58f5-b660-45b7-a756-f3fd8e38cb53 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:26.171440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1eff58f5-b660-45b7-a756-f3fd8e38cb53 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:26.185303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-581d1e66-3edf-4633-979b-1cafa2b4e62d req-d96ccaa5-6fef-457d-a4e3-86ca182b280e service nova] Creating event network-changed:23369559-a855-4cb3-8ac2-eac8b5506e56 for instance feb60f26-2b88-48af-81dd-927c66dc681f on hv-cinder-73362 Apr 16 16:51:26.194219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-581d1e66-3edf-4633-979b-1cafa2b4e62d req-d96ccaa5-6fef-457d-a4e3-86ca182b280e service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050951 Apr 16 16:51:26.195210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 133/240] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:51:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:26.243546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b718f0d5-1145-47d9-8dd1-2ddb471570a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:26.244607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b718f0d5-1145-47d9-8dd1-2ddb471570a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:26.254783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b718f0d5-1145-47d9-8dd1-2ddb471570a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:26.255607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b718f0d5-1145-47d9-8dd1-2ddb471570a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:26.257175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b718f0d5-1145-47d9-8dd1-2ddb471570a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:26.257889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b718f0d5-1145-47d9-8dd1-2ddb471570a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:26.785798 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b718f0d5-1145-47d9-8dd1-2ddb471570a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:26.804115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b718f0d5-1145-47d9-8dd1-2ddb471570a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1502 microversion: 2.1 time: 0.566454 Apr 16 16:51:26.805753 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 134/241] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:26 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1502 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:26.811442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d50f5445-ebeb-4615-a717-5a85df21eaee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:26.812726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d50f5445-ebeb-4615-a717-5a85df21eaee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:26.822050 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d50f5445-ebeb-4615-a717-5a85df21eaee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:26.822912 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d50f5445-ebeb-4615-a717-5a85df21eaee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:26.824744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d50f5445-ebeb-4615-a717-5a85df21eaee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:26.825432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d50f5445-ebeb-4615-a717-5a85df21eaee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:26.983513 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d50f5445-ebeb-4615-a717-5a85df21eaee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 26505 microversion: 2.1 time: 0.176028 Apr 16 16:51:26.984799 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 135/242] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:26 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 26505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:27.011475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d1896e73-0381-481d-a21c-8a0ac2897540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:27.015485 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d1896e73-0381-481d-a21c-8a0ac2897540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:27.058437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1896e73-0381-481d-a21c-8a0ac2897540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:27.058967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1896e73-0381-481d-a21c-8a0ac2897540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:27.059853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1896e73-0381-481d-a21c-8a0ac2897540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:27.060350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1896e73-0381-481d-a21c-8a0ac2897540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:27.136736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1eff58f5-b660-45b7-a756-f3fd8e38cb53 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:27.154208 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1eff58f5-b660-45b7-a756-f3fd8e38cb53 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1321 microversion: 2.1 time: 1.011375 Apr 16 16:51:27.155473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 108/243] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:26 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1321 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:27.164618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-93763330-de4a-4fd4-8d26-079292ad6c2c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:27.168121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-93763330-de4a-4fd4-8d26-079292ad6c2c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:27.186708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-93763330-de4a-4fd4-8d26-079292ad6c2c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:27.187578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-93763330-de4a-4fd4-8d26-079292ad6c2c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:27.189374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-93763330-de4a-4fd4-8d26-079292ad6c2c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:27.191335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-93763330-de4a-4fd4-8d26-079292ad6c2c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:27.248435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d1896e73-0381-481d-a21c-8a0ac2897540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 27681 microversion: 2.20 time: 0.261886 Apr 16 16:51:27.251050 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 136/244] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:26 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 27681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:27.629407 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-93763330-de4a-4fd4-8d26-079292ad6c2c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:27.641468 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-93763330-de4a-4fd4-8d26-079292ad6c2c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.484704 Apr 16 16:51:27.642260 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 109/245] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:27 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:27.799082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-14f5d922-3623-4c1f-b004-517c0aea1a73 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:27.800243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-14f5d922-3623-4c1f-b004-517c0aea1a73 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:27.809986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14f5d922-3623-4c1f-b004-517c0aea1a73 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:27.810770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14f5d922-3623-4c1f-b004-517c0aea1a73 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:27.811790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14f5d922-3623-4c1f-b004-517c0aea1a73 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:27.812999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14f5d922-3623-4c1f-b004-517c0aea1a73 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:27.890767 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-14f5d922-3623-4c1f-b004-517c0aea1a73 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:51:27.997271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5b9e62ce-f360-4d72-a408-a711d839d5fb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:28.006925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5b9e62ce-f360-4d72-a408-a711d839d5fb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:28.026813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b9e62ce-f360-4d72-a408-a711d839d5fb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:28.027580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b9e62ce-f360-4d72-a408-a711d839d5fb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:28.028678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b9e62ce-f360-4d72-a408-a711d839d5fb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:28.039448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b9e62ce-f360-4d72-a408-a711d839d5fb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:28.113393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-14f5d922-3623-4c1f-b004-517c0aea1a73 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "DELETE /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 204 len: 0 microversion: 2.1 time: 0.319115 Apr 16 16:51:28.120413 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 137/246] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:51:27 2021] DELETE /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:51:28.129493 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b7b997f7-42e4-47a5-b0d7-8699d999027f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:28.131524 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b7b997f7-42e4-47a5-b0d7-8699d999027f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:28.142312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7b997f7-42e4-47a5-b0d7-8699d999027f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:28.143071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7b997f7-42e4-47a5-b0d7-8699d999027f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:28.144331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7b997f7-42e4-47a5-b0d7-8699d999027f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:28.144606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7b997f7-42e4-47a5-b0d7-8699d999027f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:28.295859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5b9e62ce-f360-4d72-a408-a711d839d5fb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 27119 microversion: 2.1 time: 0.301171 Apr 16 16:51:28.302356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 110/247] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:27 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 27119 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:28.305254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1154005f-d050-4865-ae3f-45b8929e5e35 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:28.306642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1154005f-d050-4865-ae3f-45b8929e5e35 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:28.317789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1154005f-d050-4865-ae3f-45b8929e5e35 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:28.318477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1154005f-d050-4865-ae3f-45b8929e5e35 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:28.319507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1154005f-d050-4865-ae3f-45b8929e5e35 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:28.319999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1154005f-d050-4865-ae3f-45b8929e5e35 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:29.462939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b7b997f7-42e4-47a5-b0d7-8699d999027f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:29.475156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b7b997f7-42e4-47a5-b0d7-8699d999027f tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1508 microversion: 2.1 time: 1.351969 Apr 16 16:51:29.476015 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 138/248] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:28 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1508 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:29.481488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bfecca61-5ee4-4fad-91c7-36c93d7a573b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:29.482730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bfecca61-5ee4-4fad-91c7-36c93d7a573b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:29.491632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bfecca61-5ee4-4fad-91c7-36c93d7a573b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:29.492376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bfecca61-5ee4-4fad-91c7-36c93d7a573b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:29.493365 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bfecca61-5ee4-4fad-91c7-36c93d7a573b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:29.493996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bfecca61-5ee4-4fad-91c7-36c93d7a573b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:29.619492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bfecca61-5ee4-4fad-91c7-36c93d7a573b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 28144 microversion: 2.20 time: 0.141851 Apr 16 16:51:29.624219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 139/249] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:29 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 28144 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:29.629797 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5f4fcd12-b8b2-4185-8140-e4b7fb71fa0f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:29.630996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5f4fcd12-b8b2-4185-8140-e4b7fb71fa0f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:29.643130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f4fcd12-b8b2-4185-8140-e4b7fb71fa0f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:29.644773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f4fcd12-b8b2-4185-8140-e4b7fb71fa0f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:29.646700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f4fcd12-b8b2-4185-8140-e4b7fb71fa0f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:29.647323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f4fcd12-b8b2-4185-8140-e4b7fb71fa0f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:29.823831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1154005f-d050-4865-ae3f-45b8929e5e35 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:29.845473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1154005f-d050-4865-ae3f-45b8929e5e35 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1321 microversion: 2.1 time: 1.546905 Apr 16 16:51:29.848825 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 111/250] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:28 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1321 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:30.292085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-94f16a83-376b-4186-b4f2-59ea75191cf7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Action: 'create', calling method: .version_select at 0x7f0d450f3840>, body: {"keypair": {"name": "tempest-TestShelveInstance-198386243"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:30.320987 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-94f16a83-376b-4186-b4f2-59ea75191cf7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Getting quotas for project 36e2bc75e4e1400fab18b3944402fa76. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:51:30.325532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-94f16a83-376b-4186-b4f2-59ea75191cf7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Getting quotas for user 095c903e1e3747aa8c7201ca585aef54 and project 36e2bc75e4e1400fab18b3944402fa76. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:51:30.436181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5f4fcd12-b8b2-4185-8140-e4b7fb71fa0f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:30.446491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5f4fcd12-b8b2-4185-8140-e4b7fb71fa0f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.824638 Apr 16 16:51:30.447131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 140/251] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:29 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:30.462609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1e51b934-6c73-451b-94fe-6d609f6ff767 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:30.463712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1e51b934-6c73-451b-94fe-6d609f6ff767 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:30.479328 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e51b934-6c73-451b-94fe-6d609f6ff767 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:30.479848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e51b934-6c73-451b-94fe-6d609f6ff767 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:30.480727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e51b934-6c73-451b-94fe-6d609f6ff767 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:30.481185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e51b934-6c73-451b-94fe-6d609f6ff767 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:30.539794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-94f16a83-376b-4186-b4f2-59ea75191cf7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Getting quotas for project 36e2bc75e4e1400fab18b3944402fa76. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:51:30.545088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-94f16a83-376b-4186-b4f2-59ea75191cf7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Getting quotas for user 095c903e1e3747aa8c7201ca585aef54 and project 36e2bc75e4e1400fab18b3944402fa76. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:51:30.561354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-94f16a83-376b-4186-b4f2-59ea75191cf7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.700092 Apr 16 16:51:30.562392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 112/252] 10.222.0.103 () {60 vars in 1153 bytes} [Fri Apr 16 16:51:29 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:30.578133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0d039c06-1fe9-443c-bfce-c3e1515958d2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:30.579073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0d039c06-1fe9-443c-bfce-c3e1515958d2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:30.590150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d039c06-1fe9-443c-bfce-c3e1515958d2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:30.591107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d039c06-1fe9-443c-bfce-c3e1515958d2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:30.592484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d039c06-1fe9-443c-bfce-c3e1515958d2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:30.593202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d039c06-1fe9-443c-bfce-c3e1515958d2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:30.672367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1e51b934-6c73-451b-94fe-6d609f6ff767 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 27793 microversion: 2.1 time: 0.223818 Apr 16 16:51:30.676353 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 141/253] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:30 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 27793 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:30.691699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e2d75bd7-cb51-42ac-b5ed-f68d91444b86 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:30.701393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e2d75bd7-cb51-42ac-b5ed-f68d91444b86 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:30.729544 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2d75bd7-cb51-42ac-b5ed-f68d91444b86 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:30.736187 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2d75bd7-cb51-42ac-b5ed-f68d91444b86 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:30.737591 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2d75bd7-cb51-42ac-b5ed-f68d91444b86 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:30.738697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2d75bd7-cb51-42ac-b5ed-f68d91444b86 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:30.887350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e2d75bd7-cb51-42ac-b5ed-f68d91444b86 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 28144 microversion: 2.20 time: 0.209197 Apr 16 16:51:30.888770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 142/254] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:30 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 28144 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:30.901726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-aff723a2-573f-4188-b36b-6345e5bac8c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:30.902657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-aff723a2-573f-4188-b36b-6345e5bac8c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:30.916940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aff723a2-573f-4188-b36b-6345e5bac8c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:30.917552 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aff723a2-573f-4188-b36b-6345e5bac8c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:30.918597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aff723a2-573f-4188-b36b-6345e5bac8c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:30.919172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aff723a2-573f-4188-b36b-6345e5bac8c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:31.751705 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0d039c06-1fe9-443c-bfce-c3e1515958d2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:31.762989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0d039c06-1fe9-443c-bfce-c3e1515958d2 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1508 microversion: 2.1 time: 1.195400 Apr 16 16:51:31.763624 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 113/255] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:30 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1508 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:31.786953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9be99a7e-8636-4e00-b0a3-ca6e3b26d343 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:31.787618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9be99a7e-8636-4e00-b0a3-ca6e3b26d343 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:31.812196 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9be99a7e-8636-4e00-b0a3-ca6e3b26d343 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:31.812632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9be99a7e-8636-4e00-b0a3-ca6e3b26d343 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:31.813599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9be99a7e-8636-4e00-b0a3-ca6e3b26d343 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:31.814085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9be99a7e-8636-4e00-b0a3-ca6e3b26d343 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:32.377543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-aff723a2-573f-4188-b36b-6345e5bac8c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:32.404937 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-aff723a2-573f-4188-b36b-6345e5bac8c6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1321 microversion: 2.1 time: 1.513584 Apr 16 16:51:32.405598 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 143/256] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:30 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1321 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:32.428768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-544fea41-a099-42e8-8ed4-566234d9f0c9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:32.430310 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-544fea41-a099-42e8-8ed4-566234d9f0c9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:32.439272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-544fea41-a099-42e8-8ed4-566234d9f0c9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:32.440065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-544fea41-a099-42e8-8ed4-566234d9f0c9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:32.441153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-544fea41-a099-42e8-8ed4-566234d9f0c9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:32.441966 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-544fea41-a099-42e8-8ed4-566234d9f0c9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:32.642922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-544fea41-a099-42e8-8ed4-566234d9f0c9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 28180 microversion: 2.1 time: 0.233354 Apr 16 16:51:32.644969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 144/257] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:32 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 28180 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:32.675678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2b34c03a-78dc-4317-ad60-d388352423c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:32.677094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2b34c03a-78dc-4317-ad60-d388352423c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:32.687982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b34c03a-78dc-4317-ad60-d388352423c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:32.688482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b34c03a-78dc-4317-ad60-d388352423c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:32.689404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b34c03a-78dc-4317-ad60-d388352423c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:32.689893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b34c03a-78dc-4317-ad60-d388352423c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:32.816528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2b34c03a-78dc-4317-ad60-d388352423c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 28434 microversion: 2.20 time: 0.164327 Apr 16 16:51:32.818022 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 145/258] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:32 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 28434 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:32.829597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9be99a7e-8636-4e00-b0a3-ca6e3b26d343 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:32.847160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b767941a-e2a0-4350-8347-ea7876cec31b tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:32.848748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9be99a7e-8636-4e00-b0a3-ca6e3b26d343 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 1.084000 Apr 16 16:51:32.849952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b767941a-e2a0-4350-8347-ea7876cec31b tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:32.850834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 114/259] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:31 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:32.862021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b767941a-e2a0-4350-8347-ea7876cec31b tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:32.871757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b767941a-e2a0-4350-8347-ea7876cec31b tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:32.873490 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b767941a-e2a0-4350-8347-ea7876cec31b tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:32.874613 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b767941a-e2a0-4350-8347-ea7876cec31b tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:32.962169 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-2ace81a2-acd3-4bc8-8aee-550b68006c31 req-dd236cab-866a-4cde-95cd-38438268e910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28a807c-7fe0-43e9-90d4-afbc06b99029", "name": "network-vif-deleted", "tag": "da606ecb-e349-4795-bddb-3c2db704b112"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:32.973445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:51:32.973445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:51:32.995661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-2ace81a2-acd3-4bc8-8aee-550b68006c31 req-dd236cab-866a-4cde-95cd-38438268e910 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:32.996266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-2ace81a2-acd3-4bc8-8aee-550b68006c31 req-dd236cab-866a-4cde-95cd-38438268e910 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:33.040722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-2ace81a2-acd3-4bc8-8aee-550b68006c31 req-dd236cab-866a-4cde-95cd-38438268e910 service nova] Creating event network-vif-deleted:da606ecb-e349-4795-bddb-3c2db704b112 for instance d28a807c-7fe0-43e9-90d4-afbc06b99029 on hv-cinder-73362 Apr 16 16:51:33.060120 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-2ace81a2-acd3-4bc8-8aee-550b68006c31 req-dd236cab-866a-4cde-95cd-38438268e910 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106945 Apr 16 16:51:33.061351 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 115/260] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:51:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:33.358158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b767941a-e2a0-4350-8347-ea7876cec31b tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:33.376919 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b767941a-e2a0-4350-8347-ea7876cec31b tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 200 len: 1303 microversion: 2.1 time: 0.552692 Apr 16 16:51:33.377352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 146/261] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:32 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 1303 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:33.427105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ced50504-4170-4bee-8d3d-01ac9d4cd5b8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:33.427768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ced50504-4170-4bee-8d3d-01ac9d4cd5b8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:33.437904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ced50504-4170-4bee-8d3d-01ac9d4cd5b8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:33.438700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ced50504-4170-4bee-8d3d-01ac9d4cd5b8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:33.440260 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ced50504-4170-4bee-8d3d-01ac9d4cd5b8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:33.441442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ced50504-4170-4bee-8d3d-01ac9d4cd5b8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:33.658649 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6625ffb2-e856-445f-8770-19b0f8237fcc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:33.660659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6625ffb2-e856-445f-8770-19b0f8237fcc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:33.691222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6625ffb2-e856-445f-8770-19b0f8237fcc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:33.693269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6625ffb2-e856-445f-8770-19b0f8237fcc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:33.694268 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6625ffb2-e856-445f-8770-19b0f8237fcc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:33.696147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6625ffb2-e856-445f-8770-19b0f8237fcc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:33.889671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ced50504-4170-4bee-8d3d-01ac9d4cd5b8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:33.903008 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ced50504-4170-4bee-8d3d-01ac9d4cd5b8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1321 microversion: 2.1 time: 0.481325 Apr 16 16:51:33.903865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 116/262] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:33 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1321 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:33.926194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-759b3a47-46ca-41f1-b89a-fd2812949ea3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:33.927710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-759b3a47-46ca-41f1-b89a-fd2812949ea3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:33.929134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6625ffb2-e856-445f-8770-19b0f8237fcc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 28180 microversion: 2.1 time: 0.275250 Apr 16 16:51:33.933691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 147/263] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:33 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 28180 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:33.940265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9d24ab9c-9455-45a6-a143-a0582e5d7d8a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:33.943794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9d24ab9c-9455-45a6-a143-a0582e5d7d8a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:33.944215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-759b3a47-46ca-41f1-b89a-fd2812949ea3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:33.944724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-759b3a47-46ca-41f1-b89a-fd2812949ea3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:33.950930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-759b3a47-46ca-41f1-b89a-fd2812949ea3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:33.951443 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-759b3a47-46ca-41f1-b89a-fd2812949ea3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:33.963488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d24ab9c-9455-45a6-a143-a0582e5d7d8a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:33.970906 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d24ab9c-9455-45a6-a143-a0582e5d7d8a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:33.972074 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d24ab9c-9455-45a6-a143-a0582e5d7d8a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:33.974388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d24ab9c-9455-45a6-a143-a0582e5d7d8a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:34.231023 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-759b3a47-46ca-41f1-b89a-fd2812949ea3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 28602 microversion: 2.20 time: 0.325506 Apr 16 16:51:34.232567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 117/264] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:33 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 28602 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:34.397389 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-91ed1611-6e87-43f4-b663-4a74ce716203 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:34.398932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-91ed1611-6e87-43f4-b663-4a74ce716203 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: d28a807c-7fe0-43e9-90d4-afbc06b99029] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:34.414907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-91ed1611-6e87-43f4-b663-4a74ce716203 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:34.416120 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-91ed1611-6e87-43f4-b663-4a74ce716203 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:34.417227 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-91ed1611-6e87-43f4-b663-4a74ce716203 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:34.418338 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-91ed1611-6e87-43f4-b663-4a74ce716203 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:34.436122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9d24ab9c-9455-45a6-a143-a0582e5d7d8a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:34.456963 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9d24ab9c-9455-45a6-a143-a0582e5d7d8a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.521593 Apr 16 16:51:34.457581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 148/265] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:33 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:34.521846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-91ed1611-6e87-43f4-b663-4a74ce716203 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] HTTP exception thrown: Instance d28a807c-7fe0-43e9-90d4-afbc06b99029 could not be found. Apr 16 16:51:34.522557 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-91ed1611-6e87-43f4-b663-4a74ce716203 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Returning 404 to user: Instance d28a807c-7fe0-43e9-90d4-afbc06b99029 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:51:34.523435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-91ed1611-6e87-43f4-b663-4a74ce716203 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029" status: 404 len: 111 microversion: 2.1 time: 0.131701 Apr 16 16:51:34.524207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 118/266] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:34 2021] GET /compute/v2.1/servers/d28a807c-7fe0-43e9-90d4-afbc06b99029 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:51:34.680595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-392822556", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "networks": [{"uuid": "f0049d23-d06a-45a0-91cb-3ec160e2a601"}]}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:34.767839 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] validate_networks() for [('f0049d23-d06a-45a0-91cb-3ec160e2a601', None, None, None)] {{(pid=99398) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:51:34.921511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c54c2e46-4684-4f27-934b-8b809385db07 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:34.922804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c54c2e46-4684-4f27-934b-8b809385db07 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:34.935945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c54c2e46-4684-4f27-934b-8b809385db07 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:34.936755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c54c2e46-4684-4f27-934b-8b809385db07 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:34.937857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c54c2e46-4684-4f27-934b-8b809385db07 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:34.938317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c54c2e46-4684-4f27-934b-8b809385db07 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:35.506587 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c54c2e46-4684-4f27-934b-8b809385db07 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:35.519791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c54c2e46-4684-4f27-934b-8b809385db07 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1321 microversion: 2.1 time: 0.602463 Apr 16 16:51:35.520421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 119/267] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:34 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:35.532738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-07688bc1-d565-4014-94db-32cfb1ec3d01 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:35.533783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-07688bc1-d565-4014-94db-32cfb1ec3d01 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:35.555140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07688bc1-d565-4014-94db-32cfb1ec3d01 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:35.555643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07688bc1-d565-4014-94db-32cfb1ec3d01 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:35.556484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07688bc1-d565-4014-94db-32cfb1ec3d01 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:35.562188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07688bc1-d565-4014-94db-32cfb1ec3d01 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:35.603509 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Flavor limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:51:35.604245 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Image limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:51:35.605122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Flavor pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:51:35.605780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Image pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:51:35.606474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:51:35.620883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:35.622089 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:35.623165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:35.623859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:35.645751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Getting quotas for project 1d5f124676424457a8eb80eafbc0b97d. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:51:35.651302 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Getting quotas for user ba3fd35d4ec74a419ff480b118cefaee and project 1d5f124676424457a8eb80eafbc0b97d. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:51:35.667354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Going to run 1 instances... {{(pid=99398) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:51:35.670317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:51:35.709549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-07688bc1-d565-4014-94db-32cfb1ec3d01 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 28471 microversion: 2.1 time: 0.187651 Apr 16 16:51:35.710179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 120/268] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:35 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 28471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:35.718147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d80dca16-cbef-4f50-9ec2-a51e0c20c3be tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:35.719335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d80dca16-cbef-4f50-9ec2-a51e0c20c3be tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:35.728868 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d80dca16-cbef-4f50-9ec2-a51e0c20c3be tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:35.729607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d80dca16-cbef-4f50-9ec2-a51e0c20c3be tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:35.730625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d80dca16-cbef-4f50-9ec2-a51e0c20c3be tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:35.731298 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d80dca16-cbef-4f50-9ec2-a51e0c20c3be tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:35.741651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6ba09967-0057-4dd8-9967-54bb598701c9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.064850 Apr 16 16:51:35.754666 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 149/269] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:51:34 2021] POST /compute/v2.1/servers => generated 382 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:51:35.761606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ec7d3c6a-53c1-4982-a689-866ce72ab142 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:35.767219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ec7d3c6a-53c1-4982-a689-866ce72ab142 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:35.792698 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ec7d3c6a-53c1-4982-a689-866ce72ab142 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:35.793495 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ec7d3c6a-53c1-4982-a689-866ce72ab142 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:35.795366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ec7d3c6a-53c1-4982-a689-866ce72ab142 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:35.797155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ec7d3c6a-53c1-4982-a689-866ce72ab142 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:35.855194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d80dca16-cbef-4f50-9ec2-a51e0c20c3be tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 28602 microversion: 2.20 time: 0.143093 Apr 16 16:51:35.858541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 121/270] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:35 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 28602 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:35.865584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f280b119-47db-4b62-b314-43359c6c2619 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:35.867204 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f280b119-47db-4b62-b314-43359c6c2619 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:36.018146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f280b119-47db-4b62-b314-43359c6c2619 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:36.047359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f280b119-47db-4b62-b314-43359c6c2619 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1217 microversion: 2.1 time: 0.189964 Apr 16 16:51:36.053795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 122/271] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:35 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:36.195966 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ec7d3c6a-53c1-4982-a689-866ce72ab142 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:36.206631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ec7d3c6a-53c1-4982-a689-866ce72ab142 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.450295 Apr 16 16:51:36.214622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 150/272] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:35 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:36.539471 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-162cf603-05da-4425-b1ad-1b7ac8b5f067 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:36.540451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-162cf603-05da-4425-b1ad-1b7ac8b5f067 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:36.552284 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-162cf603-05da-4425-b1ad-1b7ac8b5f067 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:36.553099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-162cf603-05da-4425-b1ad-1b7ac8b5f067 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:36.554199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-162cf603-05da-4425-b1ad-1b7ac8b5f067 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:36.554906 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-162cf603-05da-4425-b1ad-1b7ac8b5f067 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:36.654979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-429f19c0-30e9-4245-8b85-90ebfa45ffef req-c392222a-1933-4740-98fd-83e4fa310750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb60f26-2b88-48af-81dd-927c66dc681f", "name": "network-vif-plugged", "status": "completed", "tag": "23369559-a855-4cb3-8ac2-eac8b5506e56"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:36.656967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:51:36.656967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:51:36.669446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-429f19c0-30e9-4245-8b85-90ebfa45ffef req-c392222a-1933-4740-98fd-83e4fa310750 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:36.670113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-429f19c0-30e9-4245-8b85-90ebfa45ffef req-c392222a-1933-4740-98fd-83e4fa310750 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:36.689429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-429f19c0-30e9-4245-8b85-90ebfa45ffef req-c392222a-1933-4740-98fd-83e4fa310750 service nova] Creating event network-vif-plugged:23369559-a855-4cb3-8ac2-eac8b5506e56 for instance feb60f26-2b88-48af-81dd-927c66dc681f on hv-cinder-73362 Apr 16 16:51:36.695884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-429f19c0-30e9-4245-8b85-90ebfa45ffef req-c392222a-1933-4740-98fd-83e4fa310750 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045070 Apr 16 16:51:36.696704 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 151/273] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:51:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:36.745459 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b2407b75-5f9e-4a72-867d-2821aa4776ec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:36.746954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b2407b75-5f9e-4a72-867d-2821aa4776ec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:36.766603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b2407b75-5f9e-4a72-867d-2821aa4776ec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:36.766603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b2407b75-5f9e-4a72-867d-2821aa4776ec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:36.766603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b2407b75-5f9e-4a72-867d-2821aa4776ec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:36.766603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b2407b75-5f9e-4a72-867d-2821aa4776ec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:36.843314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-162cf603-05da-4425-b1ad-1b7ac8b5f067 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:36.852928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-162cf603-05da-4425-b1ad-1b7ac8b5f067 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1321 microversion: 2.1 time: 0.318665 Apr 16 16:51:36.853549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 123/274] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:36 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:36.869479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4f433ba6-a984-4729-b0b0-b79ab893b7bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:36.870601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4f433ba6-a984-4729-b0b0-b79ab893b7bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:36.883139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f433ba6-a984-4729-b0b0-b79ab893b7bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:36.883734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f433ba6-a984-4729-b0b0-b79ab893b7bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:36.884728 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f433ba6-a984-4729-b0b0-b79ab893b7bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:36.885254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f433ba6-a984-4729-b0b0-b79ab893b7bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:36.929225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b2407b75-5f9e-4a72-867d-2821aa4776ec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 28639 microversion: 2.1 time: 0.202044 Apr 16 16:51:36.930633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 152/275] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:36 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 28639 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:37.038802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4f433ba6-a984-4729-b0b0-b79ab893b7bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 28602 microversion: 2.20 time: 0.174383 Apr 16 16:51:37.040474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 124/276] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:36 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 28602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:37.067440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-32d7b8c4-e666-45cd-8cf3-5d38cd3725cb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:37.068498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-32d7b8c4-e666-45cd-8cf3-5d38cd3725cb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:37.099233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32d7b8c4-e666-45cd-8cf3-5d38cd3725cb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:37.099900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32d7b8c4-e666-45cd-8cf3-5d38cd3725cb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:37.100906 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32d7b8c4-e666-45cd-8cf3-5d38cd3725cb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:37.101519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32d7b8c4-e666-45cd-8cf3-5d38cd3725cb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:37.226449 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6840f7c6-6dd7-432e-bb7c-df52319cdda4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:37.227225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6840f7c6-6dd7-432e-bb7c-df52319cdda4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:37.237686 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6840f7c6-6dd7-432e-bb7c-df52319cdda4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:37.238209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6840f7c6-6dd7-432e-bb7c-df52319cdda4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:37.239100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6840f7c6-6dd7-432e-bb7c-df52319cdda4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:37.239597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6840f7c6-6dd7-432e-bb7c-df52319cdda4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:37.287504 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-32d7b8c4-e666-45cd-8cf3-5d38cd3725cb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:37.303132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-32d7b8c4-e666-45cd-8cf3-5d38cd3725cb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1269 microversion: 2.1 time: 0.241227 Apr 16 16:51:37.310780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 153/277] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:37 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1269 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:37.595956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6840f7c6-6dd7-432e-bb7c-df52319cdda4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:37.614956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6840f7c6-6dd7-432e-bb7c-df52319cdda4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.393530 Apr 16 16:51:37.622027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 125/278] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:37 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:37.872432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f0b263ed-0c0b-4bab-a0ba-c05ac1845da6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:37.873440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f0b263ed-0c0b-4bab-a0ba-c05ac1845da6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:37.892060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f0b263ed-0c0b-4bab-a0ba-c05ac1845da6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:37.892957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f0b263ed-0c0b-4bab-a0ba-c05ac1845da6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:37.894747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f0b263ed-0c0b-4bab-a0ba-c05ac1845da6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:37.895532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f0b263ed-0c0b-4bab-a0ba-c05ac1845da6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:37.948826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-681b3a6f-1ab0-4d11-81e8-f68546b3d2cf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:37.949873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-681b3a6f-1ab0-4d11-81e8-f68546b3d2cf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:37.960566 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681b3a6f-1ab0-4d11-81e8-f68546b3d2cf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:37.961542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681b3a6f-1ab0-4d11-81e8-f68546b3d2cf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:37.962809 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681b3a6f-1ab0-4d11-81e8-f68546b3d2cf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:37.963466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681b3a6f-1ab0-4d11-81e8-f68546b3d2cf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:38.142354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-681b3a6f-1ab0-4d11-81e8-f68546b3d2cf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 28639 microversion: 2.1 time: 0.204607 Apr 16 16:51:38.145366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 126/279] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:37 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 28639 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:38.152776 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1ea9e2e2-4741-45b5-9191-7988319d4254 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:38.154349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1ea9e2e2-4741-45b5-9191-7988319d4254 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:38.169568 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ea9e2e2-4741-45b5-9191-7988319d4254 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:38.170074 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ea9e2e2-4741-45b5-9191-7988319d4254 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:38.170928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ea9e2e2-4741-45b5-9191-7988319d4254 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:38.171599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ea9e2e2-4741-45b5-9191-7988319d4254 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:38.340460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1ea9e2e2-4741-45b5-9191-7988319d4254 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 28602 microversion: 2.20 time: 0.193167 Apr 16 16:51:38.341845 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 127/280] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:38 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 28602 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:38.350402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4a403b68-f26a-4103-9317-90ad0587efe4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:38.351634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4a403b68-f26a-4103-9317-90ad0587efe4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:38.360086 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4a403b68-f26a-4103-9317-90ad0587efe4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:38.362046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4a403b68-f26a-4103-9317-90ad0587efe4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:38.392429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4a403b68-f26a-4103-9317-90ad0587efe4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:38.399565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4a403b68-f26a-4103-9317-90ad0587efe4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:38.415298 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f0b263ed-0c0b-4bab-a0ba-c05ac1845da6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:38.430138 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f0b263ed-0c0b-4bab-a0ba-c05ac1845da6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1321 microversion: 2.1 time: 0.561917 Apr 16 16:51:38.443462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 154/281] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:37 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:38.640305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-08ee24a9-affb-4bea-a172-83b12a13dea1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:38.641366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-08ee24a9-affb-4bea-a172-83b12a13dea1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:38.652584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08ee24a9-affb-4bea-a172-83b12a13dea1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:38.653655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08ee24a9-affb-4bea-a172-83b12a13dea1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:38.654857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08ee24a9-affb-4bea-a172-83b12a13dea1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:38.655597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08ee24a9-affb-4bea-a172-83b12a13dea1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:38.868104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4a403b68-f26a-4103-9317-90ad0587efe4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:38.891957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4a403b68-f26a-4103-9317-90ad0587efe4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1275 microversion: 2.1 time: 0.547675 Apr 16 16:51:38.892806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 128/282] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:38 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1275 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:39.160492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a155e57c-364c-410b-ac65-7155d4921eec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:39.161840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a155e57c-364c-410b-ac65-7155d4921eec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:39.172075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a155e57c-364c-410b-ac65-7155d4921eec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:39.172815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a155e57c-364c-410b-ac65-7155d4921eec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:39.173868 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a155e57c-364c-410b-ac65-7155d4921eec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:39.175246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a155e57c-364c-410b-ac65-7155d4921eec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:39.262621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-08ee24a9-affb-4bea-a172-83b12a13dea1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:39.274317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-08ee24a9-affb-4bea-a172-83b12a13dea1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.637944 Apr 16 16:51:39.275189 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 155/283] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:38 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:39.353549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e39d9a32-8b61-4b45-8475-4f0f19c86964 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:39.354820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e39d9a32-8b61-4b45-8475-4f0f19c86964 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:39.356905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a155e57c-364c-410b-ac65-7155d4921eec tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 28639 microversion: 2.1 time: 0.203207 Apr 16 16:51:39.359583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 129/284] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:39 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 28639 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:39.371985 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e39d9a32-8b61-4b45-8475-4f0f19c86964 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:39.372684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e39d9a32-8b61-4b45-8475-4f0f19c86964 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:39.373815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e39d9a32-8b61-4b45-8475-4f0f19c86964 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:39.374529 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e39d9a32-8b61-4b45-8475-4f0f19c86964 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:39.449697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-afb905d0-0aef-49d0-88d8-6913595b2637 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:39.451107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-afb905d0-0aef-49d0-88d8-6913595b2637 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:39.460766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-afb905d0-0aef-49d0-88d8-6913595b2637 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:39.461469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-afb905d0-0aef-49d0-88d8-6913595b2637 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:39.462784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-afb905d0-0aef-49d0-88d8-6913595b2637 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:39.463860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-afb905d0-0aef-49d0-88d8-6913595b2637 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:39.544465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e39d9a32-8b61-4b45-8475-4f0f19c86964 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 28602 microversion: 2.20 time: 0.194708 Apr 16 16:51:39.545829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 156/285] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:39 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 28602 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:39.913718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-786faa66-54ec-4b3a-81ad-987c6ccd5d50 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:39.914638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-786faa66-54ec-4b3a-81ad-987c6ccd5d50 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:39.932131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-786faa66-54ec-4b3a-81ad-987c6ccd5d50 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:39.932880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-786faa66-54ec-4b3a-81ad-987c6ccd5d50 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:39.934118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-786faa66-54ec-4b3a-81ad-987c6ccd5d50 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:39.934735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-786faa66-54ec-4b3a-81ad-987c6ccd5d50 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:39.946422 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-afb905d0-0aef-49d0-88d8-6913595b2637 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:39.962873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-afb905d0-0aef-49d0-88d8-6913595b2637 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1511 microversion: 2.1 time: 0.518158 Apr 16 16:51:39.966033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 130/286] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:39 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1511 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:40.294494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e0311a8b-8473-4358-bdb2-6db2a2e8bbf3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:40.295716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e0311a8b-8473-4358-bdb2-6db2a2e8bbf3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:40.308486 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e0311a8b-8473-4358-bdb2-6db2a2e8bbf3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:40.309171 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e0311a8b-8473-4358-bdb2-6db2a2e8bbf3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:40.310248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e0311a8b-8473-4358-bdb2-6db2a2e8bbf3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:40.311122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e0311a8b-8473-4358-bdb2-6db2a2e8bbf3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:40.724131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-786faa66-54ec-4b3a-81ad-987c6ccd5d50 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:40.737088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-786faa66-54ec-4b3a-81ad-987c6ccd5d50 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1317 microversion: 2.1 time: 0.829077 Apr 16 16:51:40.739227 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 157/287] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:39 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:40.744505 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-650af526-1369-408a-8dfb-c0ae76d9de0c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:40.746742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-650af526-1369-408a-8dfb-c0ae76d9de0c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:40.757546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-650af526-1369-408a-8dfb-c0ae76d9de0c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:40.758253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-650af526-1369-408a-8dfb-c0ae76d9de0c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:40.759680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-650af526-1369-408a-8dfb-c0ae76d9de0c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:40.760298 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-650af526-1369-408a-8dfb-c0ae76d9de0c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:40.910464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-650af526-1369-408a-8dfb-c0ae76d9de0c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 28639 microversion: 2.1 time: 0.168592 Apr 16 16:51:40.912326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 158/288] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:40 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 28639 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:40.919098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6aa33d3c-240b-489c-a254-6bc9b0e0b706 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:40.920807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6aa33d3c-240b-489c-a254-6bc9b0e0b706 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:40.952492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6aa33d3c-240b-489c-a254-6bc9b0e0b706 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:40.953972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6aa33d3c-240b-489c-a254-6bc9b0e0b706 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:40.956017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6aa33d3c-240b-489c-a254-6bc9b0e0b706 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:40.957425 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6aa33d3c-240b-489c-a254-6bc9b0e0b706 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:40.993378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e0311a8b-8473-4358-bdb2-6db2a2e8bbf3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:41.006235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e0311a8b-8473-4358-bdb2-6db2a2e8bbf3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1525 microversion: 2.1 time: 0.716620 Apr 16 16:51:41.009178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 131/289] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:40 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1525 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:41.187952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6aa33d3c-240b-489c-a254-6bc9b0e0b706 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 28602 microversion: 2.20 time: 0.273101 Apr 16 16:51:41.191449 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 159/290] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:40 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 28602 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:41.473192 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-8acc9302-3eeb-43b9-974b-41c9af88fa85 req-0fe28f8b-961c-4ec3-b8a6-58aaf8d019e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef2f5fa-47be-4da0-8eb6-ff5beff781ca", "tag": "6c5fa1ae-9c04-448f-99c7-0e4d8fd5c02e"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:41.475127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:51:41.475127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:51:41.485276 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-8acc9302-3eeb-43b9-974b-41c9af88fa85 req-0fe28f8b-961c-4ec3-b8a6-58aaf8d019e7 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:41.485771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-8acc9302-3eeb-43b9-974b-41c9af88fa85 req-0fe28f8b-961c-4ec3-b8a6-58aaf8d019e7 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:41.504767 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-8acc9302-3eeb-43b9-974b-41c9af88fa85 req-0fe28f8b-961c-4ec3-b8a6-58aaf8d019e7 service nova] Creating event network-changed:6c5fa1ae-9c04-448f-99c7-0e4d8fd5c02e for instance bef2f5fa-47be-4da0-8eb6-ff5beff781ca on hv-cinder-73362 Apr 16 16:51:41.509950 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-8acc9302-3eeb-43b9-974b-41c9af88fa85 req-0fe28f8b-961c-4ec3-b8a6-58aaf8d019e7 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040789 Apr 16 16:51:41.510648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 132/291] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:51:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:41.740063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ef221f2c-40af-42b1-ad38-2a745eb2cf20 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "059b50a9-62b2-4cf0-83e2-b8ad62b07bc6"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:41.741357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ef221f2c-40af-42b1-ad38-2a745eb2cf20 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:41.749894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef221f2c-40af-42b1-ad38-2a745eb2cf20 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:41.751065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef221f2c-40af-42b1-ad38-2a745eb2cf20 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:41.752107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef221f2c-40af-42b1-ad38-2a745eb2cf20 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:41.752767 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef221f2c-40af-42b1-ad38-2a745eb2cf20 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:41.757354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b7d929da-a68c-4d4d-95fd-1a47304b215a tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:41.758240 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b7d929da-a68c-4d4d-95fd-1a47304b215a tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:41.778406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7d929da-a68c-4d4d-95fd-1a47304b215a tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:41.779159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7d929da-a68c-4d4d-95fd-1a47304b215a tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:41.781737 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7d929da-a68c-4d4d-95fd-1a47304b215a tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:41.782508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7d929da-a68c-4d4d-95fd-1a47304b215a tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:42.241652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ef221f2c-40af-42b1-ad38-2a745eb2cf20 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "POST /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506791 Apr 16 16:51:42.242573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 160/292] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:51:41 2021] POST /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:42.254547 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-de019400-c303-4416-ad1b-17356c3c5998 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:42.255710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-de019400-c303-4416-ad1b-17356c3c5998 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:42.265491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de019400-c303-4416-ad1b-17356c3c5998 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:42.267578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de019400-c303-4416-ad1b-17356c3c5998 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:42.269460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de019400-c303-4416-ad1b-17356c3c5998 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:42.269974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de019400-c303-4416-ad1b-17356c3c5998 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:42.450704 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-de019400-c303-4416-ad1b-17356c3c5998 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 28639 microversion: 2.1 time: 0.200610 Apr 16 16:51:42.452522 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 161/293] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:42 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 28639 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:42.461751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-81e45875-e46b-4436-9d76-4a1f87eacac4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:42.462784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-81e45875-e46b-4436-9d76-4a1f87eacac4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:42.473949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-81e45875-e46b-4436-9d76-4a1f87eacac4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:42.476028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-81e45875-e46b-4436-9d76-4a1f87eacac4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:42.477949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-81e45875-e46b-4436-9d76-4a1f87eacac4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:42.478631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-81e45875-e46b-4436-9d76-4a1f87eacac4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:42.742101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b7d929da-a68c-4d4d-95fd-1a47304b215a tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:42.751512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b7d929da-a68c-4d4d-95fd-1a47304b215a tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1317 microversion: 2.1 time: 0.999029 Apr 16 16:51:42.752316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 133/294] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:41 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1317 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:42.772098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9d2cc2b9-f892-41b6-af87-f34376028f4c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:42.774741 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9d2cc2b9-f892-41b6-af87-f34376028f4c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:42.790572 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d2cc2b9-f892-41b6-af87-f34376028f4c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:42.791174 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d2cc2b9-f892-41b6-af87-f34376028f4c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:42.792153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d2cc2b9-f892-41b6-af87-f34376028f4c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:42.792733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d2cc2b9-f892-41b6-af87-f34376028f4c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:42.945362 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9d2cc2b9-f892-41b6-af87-f34376028f4c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 29906 microversion: 2.20 time: 0.190823 Apr 16 16:51:42.946077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 134/295] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:42 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 29906 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:42.968644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-81e45875-e46b-4436-9d76-4a1f87eacac4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:42.977896 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-81e45875-e46b-4436-9d76-4a1f87eacac4 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1505 microversion: 2.1 time: 0.523771 Apr 16 16:51:42.978537 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 162/296] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:42 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:42.996497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-64de8cce-0f34-4f60-863d-f6b7f9c8c3ac tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:42.997176 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-64de8cce-0f34-4f60-863d-f6b7f9c8c3ac tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:43.006795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-64de8cce-0f34-4f60-863d-f6b7f9c8c3ac tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:43.007288 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-64de8cce-0f34-4f60-863d-f6b7f9c8c3ac tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:43.008387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-64de8cce-0f34-4f60-863d-f6b7f9c8c3ac tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:43.008881 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-64de8cce-0f34-4f60-863d-f6b7f9c8c3ac tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:43.464854 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-34afbb86-c341-4ba9-b822-564ba2e54e0e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:43.466370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-34afbb86-c341-4ba9-b822-564ba2e54e0e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:43.477500 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34afbb86-c341-4ba9-b822-564ba2e54e0e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:43.479248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34afbb86-c341-4ba9-b822-564ba2e54e0e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:43.480565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34afbb86-c341-4ba9-b822-564ba2e54e0e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:43.481379 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34afbb86-c341-4ba9-b822-564ba2e54e0e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:43.533932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-64de8cce-0f34-4f60-863d-f6b7f9c8c3ac tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:43.546748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-64de8cce-0f34-4f60-863d-f6b7f9c8c3ac tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1521 microversion: 2.1 time: 0.554764 Apr 16 16:51:43.547710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 135/297] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:42 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:43.721356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-34afbb86-c341-4ba9-b822-564ba2e54e0e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 28639 microversion: 2.1 time: 0.260439 Apr 16 16:51:43.727096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 163/298] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:43 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 28639 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:43.771391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9b1f41fc-ebcb-4c6e-a3d8-df2b27b70200 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:43.772158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9b1f41fc-ebcb-4c6e-a3d8-df2b27b70200 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:43.818692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b1f41fc-ebcb-4c6e-a3d8-df2b27b70200 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:43.819909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b1f41fc-ebcb-4c6e-a3d8-df2b27b70200 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:43.822712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b1f41fc-ebcb-4c6e-a3d8-df2b27b70200 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:43.823406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b1f41fc-ebcb-4c6e-a3d8-df2b27b70200 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:43.958700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ce678241-daaa-49d8-862a-83f9a3c26d18 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:43.960043 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ce678241-daaa-49d8-862a-83f9a3c26d18 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:43.986061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce678241-daaa-49d8-862a-83f9a3c26d18 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:43.986734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce678241-daaa-49d8-862a-83f9a3c26d18 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:43.987803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce678241-daaa-49d8-862a-83f9a3c26d18 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:43.988383 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce678241-daaa-49d8-862a-83f9a3c26d18 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:44.134709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ce678241-daaa-49d8-862a-83f9a3c26d18 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 30811 microversion: 2.20 time: 0.180441 Apr 16 16:51:44.138970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 164/299] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:43 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 30811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:44.493675 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9b1f41fc-ebcb-4c6e-a3d8-df2b27b70200 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:44.505414 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9b1f41fc-ebcb-4c6e-a3d8-df2b27b70200 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1317 microversion: 2.1 time: 0.738769 Apr 16 16:51:44.506727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 136/300] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:43 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:44.737173 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7b0477d7-8d83-40d6-8544-a0ad398e517c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:44.743290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7b0477d7-8d83-40d6-8544-a0ad398e517c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:44.761130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b0477d7-8d83-40d6-8544-a0ad398e517c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:44.762300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b0477d7-8d83-40d6-8544-a0ad398e517c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:44.763447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b0477d7-8d83-40d6-8544-a0ad398e517c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:44.764086 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b0477d7-8d83-40d6-8544-a0ad398e517c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:44.961567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7b0477d7-8d83-40d6-8544-a0ad398e517c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 28774 microversion: 2.1 time: 0.228643 Apr 16 16:51:44.969342 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 165/301] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:44 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 28774 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:45.147609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2805d119-7e5f-47dd-b11d-21f5a1f42eab tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:45.149096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2805d119-7e5f-47dd-b11d-21f5a1f42eab tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:45.159298 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2805d119-7e5f-47dd-b11d-21f5a1f42eab tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:45.160202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2805d119-7e5f-47dd-b11d-21f5a1f42eab tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:45.161053 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2805d119-7e5f-47dd-b11d-21f5a1f42eab tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:45.161539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2805d119-7e5f-47dd-b11d-21f5a1f42eab tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:45.300825 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2805d119-7e5f-47dd-b11d-21f5a1f42eab tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 31823 microversion: 2.20 time: 0.156402 Apr 16 16:51:45.301692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 137/302] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:45 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 31823 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:45.492432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c1cc625d-4f3b-4733-8340-30c046d44c2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:45.493652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c1cc625d-4f3b-4733-8340-30c046d44c2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:45.504290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1cc625d-4f3b-4733-8340-30c046d44c2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:45.505466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1cc625d-4f3b-4733-8340-30c046d44c2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:45.506799 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1cc625d-4f3b-4733-8340-30c046d44c2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:45.507564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1cc625d-4f3b-4733-8340-30c046d44c2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:45.525951 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5b77b335-9a86-48bf-bb2b-4a3e3ef496f8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:45.527184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5b77b335-9a86-48bf-bb2b-4a3e3ef496f8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:45.542939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b77b335-9a86-48bf-bb2b-4a3e3ef496f8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:45.543419 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b77b335-9a86-48bf-bb2b-4a3e3ef496f8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:45.544455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b77b335-9a86-48bf-bb2b-4a3e3ef496f8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:45.544940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b77b335-9a86-48bf-bb2b-4a3e3ef496f8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:45.573736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-c1cc625d-4f3b-4733-8340-30c046d44c2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lazy-loading 'flavor' on Instance uuid 139562a9-bb46-4937-898d-cf6179ddc48d {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:51:45.743536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c1cc625d-4f3b-4733-8340-30c046d44c2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/action" status: 200 len: 32 microversion: 2.1 time: 0.266586 Apr 16 16:51:45.744484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 166/303] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:45 2021] POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:51:45.771545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4711ce7a-2778-41e1-82b7-701dedf016de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:45.775899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4711ce7a-2778-41e1-82b7-701dedf016de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:45.786606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4711ce7a-2778-41e1-82b7-701dedf016de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:45.787254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4711ce7a-2778-41e1-82b7-701dedf016de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:45.795030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4711ce7a-2778-41e1-82b7-701dedf016de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:45.795846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4711ce7a-2778-41e1-82b7-701dedf016de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:45.814405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5b77b335-9a86-48bf-bb2b-4a3e3ef496f8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:45.835391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5b77b335-9a86-48bf-bb2b-4a3e3ef496f8 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1317 microversion: 2.1 time: 0.315089 Apr 16 16:51:45.836121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 138/304] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:45 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:45.978030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-71b5cb45-696d-4adc-a9a9-07860864d5cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:45.979340 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-71b5cb45-696d-4adc-a9a9-07860864d5cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:45.988298 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-71b5cb45-696d-4adc-a9a9-07860864d5cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:45.988973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-71b5cb45-696d-4adc-a9a9-07860864d5cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:45.989959 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-71b5cb45-696d-4adc-a9a9-07860864d5cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:45.990608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-71b5cb45-696d-4adc-a9a9-07860864d5cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:46.140172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4711ce7a-2778-41e1-82b7-701dedf016de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:46.157185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4711ce7a-2778-41e1-82b7-701dedf016de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.406214 Apr 16 16:51:46.158588 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 167/305] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:45 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:46.174242 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-71b5cb45-696d-4adc-a9a9-07860864d5cd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 30472 microversion: 2.1 time: 0.200318 Apr 16 16:51:46.179160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 139/306] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:45 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 30472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:51:46.317299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2eea3074-f4a3-46b7-b16c-3a97a010ccf6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:46.318875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2eea3074-f4a3-46b7-b16c-3a97a010ccf6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:46.327488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2eea3074-f4a3-46b7-b16c-3a97a010ccf6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:46.328299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2eea3074-f4a3-46b7-b16c-3a97a010ccf6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:46.329215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2eea3074-f4a3-46b7-b16c-3a97a010ccf6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:46.329680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2eea3074-f4a3-46b7-b16c-3a97a010ccf6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:46.465678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2eea3074-f4a3-46b7-b16c-3a97a010ccf6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 32668 microversion: 2.20 time: 0.154113 Apr 16 16:51:46.466987 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 168/307] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:46 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 32668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:46.863154 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-861c21a7-49c3-4c9d-a5df-ce457dac63c7 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:46.865368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-861c21a7-49c3-4c9d-a5df-ce457dac63c7 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:46.877146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-861c21a7-49c3-4c9d-a5df-ce457dac63c7 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:46.877643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-861c21a7-49c3-4c9d-a5df-ce457dac63c7 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:46.878574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-861c21a7-49c3-4c9d-a5df-ce457dac63c7 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:46.879248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-861c21a7-49c3-4c9d-a5df-ce457dac63c7 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:47.126064 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-861c21a7-49c3-4c9d-a5df-ce457dac63c7 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:47.136139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-861c21a7-49c3-4c9d-a5df-ce457dac63c7 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1317 microversion: 2.1 time: 0.281994 Apr 16 16:51:47.136820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 140/308] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:46 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:47.177326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-76e0fd27-45fd-441f-a075-cd1f4fb238d0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:47.178261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-76e0fd27-45fd-441f-a075-cd1f4fb238d0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:47.187301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cdd51d3e-cdc5-4dde-a72e-ab277be71919 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:47.187507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-76e0fd27-45fd-441f-a075-cd1f4fb238d0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:47.188021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-76e0fd27-45fd-441f-a075-cd1f4fb238d0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:47.188551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cdd51d3e-cdc5-4dde-a72e-ab277be71919 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:47.189056 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-76e0fd27-45fd-441f-a075-cd1f4fb238d0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:47.189952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-76e0fd27-45fd-441f-a075-cd1f4fb238d0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:47.197340 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cdd51d3e-cdc5-4dde-a72e-ab277be71919 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:47.197839 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cdd51d3e-cdc5-4dde-a72e-ab277be71919 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:47.198700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cdd51d3e-cdc5-4dde-a72e-ab277be71919 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:47.199187 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cdd51d3e-cdc5-4dde-a72e-ab277be71919 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:47.373614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cdd51d3e-cdc5-4dde-a72e-ab277be71919 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 31189 microversion: 2.1 time: 0.190104 Apr 16 16:51:47.375196 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 141/309] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:47 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 31189 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:51:47.480324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e1b6b969-5d0e-4db5-8757-6e2853714990 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:47.481474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e1b6b969-5d0e-4db5-8757-6e2853714990 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:47.491243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1b6b969-5d0e-4db5-8757-6e2853714990 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:47.491761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1b6b969-5d0e-4db5-8757-6e2853714990 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:47.492612 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1b6b969-5d0e-4db5-8757-6e2853714990 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:47.493123 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1b6b969-5d0e-4db5-8757-6e2853714990 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:47.568249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-76e0fd27-45fd-441f-a075-cd1f4fb238d0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:47.577834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-76e0fd27-45fd-441f-a075-cd1f4fb238d0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.405767 Apr 16 16:51:47.578608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 169/310] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:47 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:47.614754 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e1b6b969-5d0e-4db5-8757-6e2853714990 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 33126 microversion: 2.20 time: 0.139583 Apr 16 16:51:47.615991 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 142/311] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:47 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 33126 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:51:48.154882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-681edc08-cb57-4a66-a243-da8dbdea5208 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:48.155664 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-681edc08-cb57-4a66-a243-da8dbdea5208 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:48.164601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681edc08-cb57-4a66-a243-da8dbdea5208 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:48.165197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681edc08-cb57-4a66-a243-da8dbdea5208 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:48.166128 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681edc08-cb57-4a66-a243-da8dbdea5208 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:48.166722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681edc08-cb57-4a66-a243-da8dbdea5208 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:48.389394 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-beacda0d-891b-4ddc-9f08-fa6efc1bd775 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:48.391205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-beacda0d-891b-4ddc-9f08-fa6efc1bd775 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:48.395803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-681edc08-cb57-4a66-a243-da8dbdea5208 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:48.406106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-beacda0d-891b-4ddc-9f08-fa6efc1bd775 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:48.406716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-beacda0d-891b-4ddc-9f08-fa6efc1bd775 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:48.407660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-beacda0d-891b-4ddc-9f08-fa6efc1bd775 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:48.407973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-681edc08-cb57-4a66-a243-da8dbdea5208 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1317 microversion: 2.1 time: 0.257078 Apr 16 16:51:48.408317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-beacda0d-891b-4ddc-9f08-fa6efc1bd775 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:48.410033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 170/312] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:48 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:48.559448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-beacda0d-891b-4ddc-9f08-fa6efc1bd775 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 31919 microversion: 2.1 time: 0.175601 Apr 16 16:51:48.563673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 143/313] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:48 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 31919 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:48.599122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-07bc4921-d2fe-4070-a582-0cf97ae0eac3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:48.599805 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-07bc4921-d2fe-4070-a582-0cf97ae0eac3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:48.607627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07bc4921-d2fe-4070-a582-0cf97ae0eac3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:48.608146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07bc4921-d2fe-4070-a582-0cf97ae0eac3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:48.608998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07bc4921-d2fe-4070-a582-0cf97ae0eac3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:48.609491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07bc4921-d2fe-4070-a582-0cf97ae0eac3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:48.628716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3a62b780-cef8-4644-9537-98662cebc9ad tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:48.630033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3a62b780-cef8-4644-9537-98662cebc9ad tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:48.638875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a62b780-cef8-4644-9537-98662cebc9ad tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:48.639388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a62b780-cef8-4644-9537-98662cebc9ad tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:48.640256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a62b780-cef8-4644-9537-98662cebc9ad tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:48.640691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a62b780-cef8-4644-9537-98662cebc9ad tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:48.794587 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3a62b780-cef8-4644-9537-98662cebc9ad tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 33371 microversion: 2.20 time: 0.170633 Apr 16 16:51:48.795608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 144/314] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:48 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 33371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:48.865298 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-07bc4921-d2fe-4070-a582-0cf97ae0eac3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:48.874191 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-07bc4921-d2fe-4070-a582-0cf97ae0eac3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.279709 Apr 16 16:51:48.874856 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 171/315] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:48 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:49.428913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1276a880-0fdc-4ba3-941c-034c6b302fec tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:49.429694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1276a880-0fdc-4ba3-941c-034c6b302fec tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:49.438400 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1276a880-0fdc-4ba3-941c-034c6b302fec tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:49.438915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1276a880-0fdc-4ba3-941c-034c6b302fec tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:49.439753 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1276a880-0fdc-4ba3-941c-034c6b302fec tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:49.440377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1276a880-0fdc-4ba3-941c-034c6b302fec tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:49.572285 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9d5b6bf1-8715-46d3-bd9e-2015bca95ff1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:49.573853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9d5b6bf1-8715-46d3-bd9e-2015bca95ff1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:49.591567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bf1-8715-46d3-bd9e-2015bca95ff1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:49.592073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bf1-8715-46d3-bd9e-2015bca95ff1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:49.592923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bf1-8715-46d3-bd9e-2015bca95ff1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:49.593414 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9d5b6bf1-8715-46d3-bd9e-2015bca95ff1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:49.697511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1276a880-0fdc-4ba3-941c-034c6b302fec tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:49.708710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1276a880-0fdc-4ba3-941c-034c6b302fec tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1317 microversion: 2.1 time: 0.284962 Apr 16 16:51:49.709342 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 145/316] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:49 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:49.760482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9d5b6bf1-8715-46d3-bd9e-2015bca95ff1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 32497 microversion: 2.1 time: 0.192312 Apr 16 16:51:49.761311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 172/317] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:49 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 32497 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:49.807444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-74b180e6-8437-40f8-ab32-0078d23e64ee tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:49.808684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-74b180e6-8437-40f8-ab32-0078d23e64ee tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:49.817025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74b180e6-8437-40f8-ab32-0078d23e64ee tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:49.817512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74b180e6-8437-40f8-ab32-0078d23e64ee tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:49.818607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74b180e6-8437-40f8-ab32-0078d23e64ee tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:49.819269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74b180e6-8437-40f8-ab32-0078d23e64ee tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:49.895149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7b856aeb-aa14-4c23-b5f8-2c8eed036a43 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:49.895914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7b856aeb-aa14-4c23-b5f8-2c8eed036a43 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:49.920959 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b856aeb-aa14-4c23-b5f8-2c8eed036a43 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:49.921663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b856aeb-aa14-4c23-b5f8-2c8eed036a43 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:49.922688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b856aeb-aa14-4c23-b5f8-2c8eed036a43 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:49.923354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b856aeb-aa14-4c23-b5f8-2c8eed036a43 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:49.977716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-74b180e6-8437-40f8-ab32-0078d23e64ee tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 33615 microversion: 2.20 time: 0.174138 Apr 16 16:51:49.979142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 146/318] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:49 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 33615 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:50.185686 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7b856aeb-aa14-4c23-b5f8-2c8eed036a43 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:50.197639 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7b856aeb-aa14-4c23-b5f8-2c8eed036a43 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.307761 Apr 16 16:51:50.198307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 173/319] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:49 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:50.346432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ad74486e-926a-443c-a99b-874a076f68e9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "059b50a9-62b2-4cf0-83e2-b8ad62b07bc6"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:50.347860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ad74486e-926a-443c-a99b-874a076f68e9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:50.357130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ad74486e-926a-443c-a99b-874a076f68e9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:50.357775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ad74486e-926a-443c-a99b-874a076f68e9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:50.358451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ad74486e-926a-443c-a99b-874a076f68e9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:50.358952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ad74486e-926a-443c-a99b-874a076f68e9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:50.717525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-ad74486e-926a-443c-a99b-874a076f68e9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] HTTP exception thrown: Invalid volume: volume 059b50a9-62b2-4cf0-83e2-b8ad62b07bc6 is already attached to instances: feb60f26-2b88-48af-81dd-927c66dc681f Apr 16 16:51:50.719472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ad74486e-926a-443c-a99b-874a076f68e9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Returning 400 to user: Invalid volume: volume 059b50a9-62b2-4cf0-83e2-b8ad62b07bc6 is already attached to instances: feb60f26-2b88-48af-81dd-927c66dc681f {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:51:50.721287 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ad74486e-926a-443c-a99b-874a076f68e9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "POST /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.379837 Apr 16 16:51:50.723274 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 147/320] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:51:50 2021] POST /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f/os-volume_attachments => generated 174 bytes in 383 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 16:51:50.743137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-90c0d136-308c-4913-b258-2cbe6a241215 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:50.743775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-90c0d136-308c-4913-b258-2cbe6a241215 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:50.754674 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90c0d136-308c-4913-b258-2cbe6a241215 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:50.755202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90c0d136-308c-4913-b258-2cbe6a241215 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:50.756037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90c0d136-308c-4913-b258-2cbe6a241215 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:50.763146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90c0d136-308c-4913-b258-2cbe6a241215 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:50.775597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3a1fc18f-159b-4ca3-84f2-6a819f1840ad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:50.782254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3a1fc18f-159b-4ca3-84f2-6a819f1840ad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:50.806747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a1fc18f-159b-4ca3-84f2-6a819f1840ad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:50.807256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a1fc18f-159b-4ca3-84f2-6a819f1840ad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:50.813284 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a1fc18f-159b-4ca3-84f2-6a819f1840ad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:50.813780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a1fc18f-159b-4ca3-84f2-6a819f1840ad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:50.979602 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3a1fc18f-159b-4ca3-84f2-6a819f1840ad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 33030 microversion: 2.1 time: 0.209583 Apr 16 16:51:50.981106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 148/321] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:50 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 33030 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:51:50.986511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-410edcd2-e60f-4e87-8af6-f2ac8961e5a1 req-b85b0443-7735-48b1-9754-2709815f835b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef2f5fa-47be-4da0-8eb6-ff5beff781ca", "name": "network-vif-plugged", "status": "completed", "tag": "6c5fa1ae-9c04-448f-99c7-0e4d8fd5c02e"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:50.992274 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:51:50.992274 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:51:51.012581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-410edcd2-e60f-4e87-8af6-f2ac8961e5a1 req-b85b0443-7735-48b1-9754-2709815f835b service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:51.013408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-410edcd2-e60f-4e87-8af6-f2ac8961e5a1 req-b85b0443-7735-48b1-9754-2709815f835b service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:51.050614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-410edcd2-e60f-4e87-8af6-f2ac8961e5a1 req-b85b0443-7735-48b1-9754-2709815f835b service nova] Creating event network-vif-plugged:6c5fa1ae-9c04-448f-99c7-0e4d8fd5c02e for instance bef2f5fa-47be-4da0-8eb6-ff5beff781ca on hv-cinder-73362 Apr 16 16:51:51.066727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-410edcd2-e60f-4e87-8af6-f2ac8961e5a1 req-b85b0443-7735-48b1-9754-2709815f835b service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083829 Apr 16 16:51:51.070360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 149/322] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:51:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:51:51.076809 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dda18569-e7d9-4b7a-81f8-bb9d75f061a6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:51.077508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dda18569-e7d9-4b7a-81f8-bb9d75f061a6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:51.086787 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dda18569-e7d9-4b7a-81f8-bb9d75f061a6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:51.087297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dda18569-e7d9-4b7a-81f8-bb9d75f061a6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:51.088147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dda18569-e7d9-4b7a-81f8-bb9d75f061a6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:51.088640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dda18569-e7d9-4b7a-81f8-bb9d75f061a6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:51.114429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-90c0d136-308c-4913-b258-2cbe6a241215 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:51.139932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-90c0d136-308c-4913-b258-2cbe6a241215 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1317 microversion: 2.1 time: 0.415148 Apr 16 16:51:51.140564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 174/323] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:50 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:51.172155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5a987b77-1aaa-47e3-bb6c-b9c0193a5341 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:51.173644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5a987b77-1aaa-47e3-bb6c-b9c0193a5341 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:51.185890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a987b77-1aaa-47e3-bb6c-b9c0193a5341 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:51.186424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a987b77-1aaa-47e3-bb6c-b9c0193a5341 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:51.187269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a987b77-1aaa-47e3-bb6c-b9c0193a5341 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:51.187758 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a987b77-1aaa-47e3-bb6c-b9c0193a5341 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:51.293555 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-dda18569-e7d9-4b7a-81f8-bb9d75f061a6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lazy-loading 'services' on Instance uuid feb60f26-2b88-48af-81dd-927c66dc681f {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:51:51.373781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5a987b77-1aaa-47e3-bb6c-b9c0193a5341 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 34136 microversion: 2.20 time: 0.221593 Apr 16 16:51:51.375344 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 175/324] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:51 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 34136 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:51.382700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-969d3381-1700-4c16-a7d0-2141dcc405ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:51.383962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-969d3381-1700-4c16-a7d0-2141dcc405ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:51.395628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-969d3381-1700-4c16-a7d0-2141dcc405ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:51.396273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-969d3381-1700-4c16-a7d0-2141dcc405ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:51.397350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-969d3381-1700-4c16-a7d0-2141dcc405ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:51.397954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-969d3381-1700-4c16-a7d0-2141dcc405ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:51.465995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dda18569-e7d9-4b7a-81f8-bb9d75f061a6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "DELETE /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f/os-volume_attachments/059b50a9-62b2-4cf0-83e2-b8ad62b07bc6" status: 202 len: 0 microversion: 2.1 time: 0.393930 Apr 16 16:51:51.466707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 150/325] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 16:51:51 2021] DELETE /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f/os-volume_attachments/059b50a9-62b2-4cf0-83e2-b8ad62b07bc6 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:51.633458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-969d3381-1700-4c16-a7d0-2141dcc405ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:51.643212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-969d3381-1700-4c16-a7d0-2141dcc405ca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.266378 Apr 16 16:51:51.643913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 176/326] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:51 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:51.997693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-02cf4920-381c-405c-bd8a-f33be0698a16 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:51.999641 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-02cf4920-381c-405c-bd8a-f33be0698a16 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:52.016178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-02cf4920-381c-405c-bd8a-f33be0698a16 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:52.017470 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-02cf4920-381c-405c-bd8a-f33be0698a16 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:52.019251 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-02cf4920-381c-405c-bd8a-f33be0698a16 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:52.020099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-02cf4920-381c-405c-bd8a-f33be0698a16 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:52.157994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5e62fba0-1f4f-4746-909e-31f412b6b486 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:52.158675 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5e62fba0-1f4f-4746-909e-31f412b6b486 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:52.167545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5e62fba0-1f4f-4746-909e-31f412b6b486 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:52.168061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5e62fba0-1f4f-4746-909e-31f412b6b486 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:52.168920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5e62fba0-1f4f-4746-909e-31f412b6b486 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:52.169412 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5e62fba0-1f4f-4746-909e-31f412b6b486 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:52.241220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-02cf4920-381c-405c-bd8a-f33be0698a16 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 33536 microversion: 2.1 time: 0.251444 Apr 16 16:51:52.242509 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 151/327] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:51 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 33536 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:51:52.389926 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8a72da95-e86b-4e33-85e0-f74fcedba23e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:52.391186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8a72da95-e86b-4e33-85e0-f74fcedba23e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:52.400210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8a72da95-e86b-4e33-85e0-f74fcedba23e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:52.400726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8a72da95-e86b-4e33-85e0-f74fcedba23e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:52.401851 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8a72da95-e86b-4e33-85e0-f74fcedba23e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:52.402367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8a72da95-e86b-4e33-85e0-f74fcedba23e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:52.408331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5e62fba0-1f4f-4746-909e-31f412b6b486 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:52.419413 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5e62fba0-1f4f-4746-909e-31f412b6b486 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1317 microversion: 2.1 time: 0.265490 Apr 16 16:51:52.420095 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 177/328] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:52 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:51:52.584642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8a72da95-e86b-4e33-85e0-f74fcedba23e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 34727 microversion: 2.20 time: 0.198571 Apr 16 16:51:52.586794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 152/329] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:52 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 34727 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:52.665967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d5742737-adb1-413f-869a-bc8676507bca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:52.666671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d5742737-adb1-413f-869a-bc8676507bca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:52.677888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5742737-adb1-413f-869a-bc8676507bca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:52.678820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5742737-adb1-413f-869a-bc8676507bca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:52.680725 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5742737-adb1-413f-869a-bc8676507bca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:52.681633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5742737-adb1-413f-869a-bc8676507bca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:52.921780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d5742737-adb1-413f-869a-bc8676507bca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:52.931683 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d5742737-adb1-413f-869a-bc8676507bca tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.273123 Apr 16 16:51:52.932311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 178/330] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:52 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:53.164687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-310785442", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:53.256160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2e998c9e-166e-424d-897c-7e7e2e298b3b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:53.256876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2e998c9e-166e-424d-897c-7e7e2e298b3b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:53.266255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e998c9e-166e-424d-897c-7e7e2e298b3b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:53.267213 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e998c9e-166e-424d-897c-7e7e2e298b3b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:53.268273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e998c9e-166e-424d-897c-7e7e2e298b3b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:53.269041 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e998c9e-166e-424d-897c-7e7e2e298b3b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:53.451608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2e998c9e-166e-424d-897c-7e7e2e298b3b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 33844 microversion: 2.1 time: 0.199672 Apr 16 16:51:53.452399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 179/331] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:51:53 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 33844 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:51:53.458585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3211e16e-4f85-4c47-93e0-bda99da60506 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:53.459346 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3211e16e-4f85-4c47-93e0-bda99da60506 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:53.467822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3211e16e-4f85-4c47-93e0-bda99da60506 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:53.468322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3211e16e-4f85-4c47-93e0-bda99da60506 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:53.469149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3211e16e-4f85-4c47-93e0-bda99da60506 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:53.469631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3211e16e-4f85-4c47-93e0-bda99da60506 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:53.689216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3211e16e-4f85-4c47-93e0-bda99da60506 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:51:53.699018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3211e16e-4f85-4c47-93e0-bda99da60506 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1501 microversion: 2.1 time: 0.245326 Apr 16 16:51:53.699665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 180/332] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:53 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1501 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:51:53.704893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-644bf909-a9f3-49cc-9cc1-93723b2a761d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:53.706581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-644bf909-a9f3-49cc-9cc1-93723b2a761d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:53.714886 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-644bf909-a9f3-49cc-9cc1-93723b2a761d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:53.715497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-644bf909-a9f3-49cc-9cc1-93723b2a761d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:53.716348 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-644bf909-a9f3-49cc-9cc1-93723b2a761d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:53.716841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-644bf909-a9f3-49cc-9cc1-93723b2a761d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:53.847881 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-644bf909-a9f3-49cc-9cc1-93723b2a761d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 35138 microversion: 2.20 time: 0.146781 Apr 16 16:51:53.848620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 181/333] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:51:53 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 35138 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:51:53.930063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1584713259", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "networks": [{"uuid": "4b2a2bf5-f241-4566-8a43-225171ec9f91"}]}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:51:58.872414 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] validate_networks() for None {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:51:58.876238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] validate_networks() for [('4b2a2bf5-f241-4566-8a43-225171ec9f91', None, None, None)] {{(pid=99398) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:51:59.347504 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:51:59.348514 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:51:59.349060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:51:59.349521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:51:59.349983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:51:59.359396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:59.359822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:59.360701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:59.361201 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:59.381186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Getting quotas for project 46bd4eea651140208d2f5828845e4557. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:51:59.385611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Getting quotas for user 7e35865ec7c54faeaf91e5a0b64af68b and project 46bd4eea651140208d2f5828845e4557. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:51:59.397584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:51:59.400384 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:51:59.458594 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-69e178b1-04ed-4f5a-9b96-0a6fca6b5004 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 6.298549 Apr 16 16:51:59.464648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 153/334] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:51:53 2021] POST /compute/v2.1/servers => generated 382 bytes in 6301 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:51:59.464648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-09c45085-8335-4c43-a5d9-06c6a44f2f87 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:51:59.465362 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-09c45085-8335-4c43-a5d9-06c6a44f2f87 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:51:59.476041 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-09c45085-8335-4c43-a5d9-06c6a44f2f87 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:59.477008 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-09c45085-8335-4c43-a5d9-06c6a44f2f87 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:51:59.477461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-09c45085-8335-4c43-a5d9-06c6a44f2f87 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:51:59.478099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-09c45085-8335-4c43-a5d9-06c6a44f2f87 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.000496 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Flavor limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:52:00.000980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Image limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:52:00.001518 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Flavor pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:52:00.001980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Image pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:52:00.002988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:52:00.021576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.022391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.023472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.024150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.079338 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Getting quotas for project a46c79620899432c8193a987ece333df. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:52:00.085623 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Getting quotas for user 44a48edfa5ca47949ffb787b0d7fe204 and project a46c79620899432c8193a987ece333df. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:52:00.086026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-09c45085-8335-4c43-a5d9-06c6a44f2f87 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:00.097077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-09c45085-8335-4c43-a5d9-06c6a44f2f87 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.636243 Apr 16 16:52:00.097466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Going to run 1 instances... {{(pid=99398) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:52:00.097878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 154/335] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:51:59 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:00.100311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:52:00.103366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-af9e0ae3-a9bc-4087-b9e4-d6d2e59a7598 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:00.104507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-af9e0ae3-a9bc-4087-b9e4-d6d2e59a7598 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:00.114462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af9e0ae3-a9bc-4087-b9e4-d6d2e59a7598 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.114908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af9e0ae3-a9bc-4087-b9e4-d6d2e59a7598 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.115795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af9e0ae3-a9bc-4087-b9e4-d6d2e59a7598 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.116284 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af9e0ae3-a9bc-4087-b9e4-d6d2e59a7598 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.154627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6911955b-8e13-4f6c-8ec4-8bceb6104e4f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 6.229614 Apr 16 16:52:00.155587 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 182/336] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:51:53 2021] POST /compute/v2.1/servers => generated 382 bytes in 6232 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:52:00.161186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-122c01ae-da94-466f-b472-95ecbb7e26ef tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:00.161973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-122c01ae-da94-466f-b472-95ecbb7e26ef tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:00.171375 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-122c01ae-da94-466f-b472-95ecbb7e26ef tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.172110 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-122c01ae-da94-466f-b472-95ecbb7e26ef tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.173130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-122c01ae-da94-466f-b472-95ecbb7e26ef tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.174100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-122c01ae-da94-466f-b472-95ecbb7e26ef tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.249257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-122c01ae-da94-466f-b472-95ecbb7e26ef tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:52:00.257647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-af9e0ae3-a9bc-4087-b9e4-d6d2e59a7598 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 36723 microversion: 2.1 time: 0.158184 Apr 16 16:52:00.258713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 155/337] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:52:00 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 36723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:52:00.289305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-563bb94e-52b3-4ed4-b238-f72366a153c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:00.290722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-563bb94e-52b3-4ed4-b238-f72366a153c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:00.299931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-563bb94e-52b3-4ed4-b238-f72366a153c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.300779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-563bb94e-52b3-4ed4-b238-f72366a153c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.301847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-563bb94e-52b3-4ed4-b238-f72366a153c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.302395 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-563bb94e-52b3-4ed4-b238-f72366a153c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.388073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-122c01ae-da94-466f-b472-95ecbb7e26ef tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "DELETE /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 204 len: 0 microversion: 2.1 time: 0.230863 Apr 16 16:52:00.388719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 183/338] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:52:00 2021] DELETE /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:52:00.395291 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-41b16af2-4e55-4a94-8053-5c2db34dc4d7 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:00.396065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-41b16af2-4e55-4a94-8053-5c2db34dc4d7 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:00.405835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-41b16af2-4e55-4a94-8053-5c2db34dc4d7 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.406511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-41b16af2-4e55-4a94-8053-5c2db34dc4d7 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.407371 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-41b16af2-4e55-4a94-8053-5c2db34dc4d7 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.407859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-41b16af2-4e55-4a94-8053-5c2db34dc4d7 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.511945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-563bb94e-52b3-4ed4-b238-f72366a153c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 38190 microversion: 2.20 time: 0.250937 Apr 16 16:52:00.513265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 156/339] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:52:00 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 38190 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:52:00.523628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-aefe70b5-af24-4c6f-9108-0893b19b086e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:00.524486 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-aefe70b5-af24-4c6f-9108-0893b19b086e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:00.545893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-41b16af2-4e55-4a94-8053-5c2db34dc4d7 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:00.555830 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-41b16af2-4e55-4a94-8053-5c2db34dc4d7 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1270 microversion: 2.1 time: 0.165824 Apr 16 16:52:00.556969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 184/340] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:00 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:00.561234 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a871ef2f-960d-4148-9e93-9a9c7733b101 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:00.561899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a871ef2f-960d-4148-9e93-9a9c7733b101 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:00.571167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a871ef2f-960d-4148-9e93-9a9c7733b101 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.571675 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a871ef2f-960d-4148-9e93-9a9c7733b101 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.572527 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a871ef2f-960d-4148-9e93-9a9c7733b101 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:00.573015 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a871ef2f-960d-4148-9e93-9a9c7733b101 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:00.618955 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-aefe70b5-af24-4c6f-9108-0893b19b086e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:00.631606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-aefe70b5-af24-4c6f-9108-0893b19b086e tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1222 microversion: 2.1 time: 0.112842 Apr 16 16:52:00.632386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 157/341] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:00 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:00.800621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a871ef2f-960d-4148-9e93-9a9c7733b101 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:00.809536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a871ef2f-960d-4148-9e93-9a9c7733b101 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1507 microversion: 2.1 time: 0.251869 Apr 16 16:52:00.810152 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 185/342] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:00 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:01.120078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bcb3e914-068e-445d-9df4-42f67e65839d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:01.120759 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bcb3e914-068e-445d-9df4-42f67e65839d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:01.131270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bcb3e914-068e-445d-9df4-42f67e65839d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.132907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bcb3e914-068e-445d-9df4-42f67e65839d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.134026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bcb3e914-068e-445d-9df4-42f67e65839d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.134625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bcb3e914-068e-445d-9df4-42f67e65839d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.270941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a0a54068-b9fe-441f-bf4a-742863375f5d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:01.272740 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a0a54068-b9fe-441f-bf4a-742863375f5d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:01.281992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a0a54068-b9fe-441f-bf4a-742863375f5d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.282828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a0a54068-b9fe-441f-bf4a-742863375f5d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.284172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a0a54068-b9fe-441f-bf4a-742863375f5d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.285550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a0a54068-b9fe-441f-bf4a-742863375f5d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.378559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bcb3e914-068e-445d-9df4-42f67e65839d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:01.389138 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bcb3e914-068e-445d-9df4-42f67e65839d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.273502 Apr 16 16:52:01.389825 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 158/343] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:01 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:01.437652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a0a54068-b9fe-441f-bf4a-742863375f5d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 37082 microversion: 2.1 time: 0.171674 Apr 16 16:52:01.438721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 186/344] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:52:01 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 37082 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:52:01.526557 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0be04ae9-b31e-45ca-9d00-82b10c24dcf7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:01.527563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0be04ae9-b31e-45ca-9d00-82b10c24dcf7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:01.537836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0be04ae9-b31e-45ca-9d00-82b10c24dcf7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.538356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0be04ae9-b31e-45ca-9d00-82b10c24dcf7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.539216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0be04ae9-b31e-45ca-9d00-82b10c24dcf7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.539711 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0be04ae9-b31e-45ca-9d00-82b10c24dcf7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.576050 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1ea058f1-2855-40c6-bec0-1728183e2c6b tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:01.576967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1ea058f1-2855-40c6-bec0-1728183e2c6b tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:01.587040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ea058f1-2855-40c6-bec0-1728183e2c6b tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.587726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ea058f1-2855-40c6-bec0-1728183e2c6b tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.588684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ea058f1-2855-40c6-bec0-1728183e2c6b tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.589387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ea058f1-2855-40c6-bec0-1728183e2c6b tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.690424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0be04ae9-b31e-45ca-9d00-82b10c24dcf7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 200 len: 38253 microversion: 2.20 time: 0.168079 Apr 16 16:52:01.691301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 159/345] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:52:01 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 38253 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:52:01.698031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c7e5952b-02d2-4b6a-9c33-9a0e1392e750 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:01.698961 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c7e5952b-02d2-4b6a-9c33-9a0e1392e750 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:01.715323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c7e5952b-02d2-4b6a-9c33-9a0e1392e750 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.715828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c7e5952b-02d2-4b6a-9c33-9a0e1392e750 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.716692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c7e5952b-02d2-4b6a-9c33-9a0e1392e750 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.717186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c7e5952b-02d2-4b6a-9c33-9a0e1392e750 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.724429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1ea058f1-2855-40c6-bec0-1728183e2c6b tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:01.734608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1ea058f1-2855-40c6-bec0-1728183e2c6b tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1276 microversion: 2.1 time: 0.163300 Apr 16 16:52:01.735672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 187/346] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:01 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:01.741396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-caeb2a0f-91c7-4f7c-b66e-c3fba69a06c8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:01.742039 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-caeb2a0f-91c7-4f7c-b66e-c3fba69a06c8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:01.750567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caeb2a0f-91c7-4f7c-b66e-c3fba69a06c8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.751204 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caeb2a0f-91c7-4f7c-b66e-c3fba69a06c8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.752154 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caeb2a0f-91c7-4f7c-b66e-c3fba69a06c8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.753431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caeb2a0f-91c7-4f7c-b66e-c3fba69a06c8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.854011 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-caeb2a0f-91c7-4f7c-b66e-c3fba69a06c8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/ips" status: 200 len: 153 microversion: 2.20 time: 0.116903 Apr 16 16:52:01.860360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 188/347] 10.222.0.103 () {60 vars in 1284 bytes} [Fri Apr 16 16:52:01 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/ips => generated 153 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:52:01.860515 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-00423141-5263-4abe-8737-5e51d479db03 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:01.863648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-00423141-5263-4abe-8737-5e51d479db03 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:01.872643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-00423141-5263-4abe-8737-5e51d479db03 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.873158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-00423141-5263-4abe-8737-5e51d479db03 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.874017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-00423141-5263-4abe-8737-5e51d479db03 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:01.874665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-00423141-5263-4abe-8737-5e51d479db03 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:01.891272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c7e5952b-02d2-4b6a-9c33-9a0e1392e750 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:01.911832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c7e5952b-02d2-4b6a-9c33-9a0e1392e750 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1274 microversion: 2.1 time: 0.219139 Apr 16 16:52:01.914708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 160/348] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:01 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:02.349953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-00423141-5263-4abe-8737-5e51d479db03 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:02.366006 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-00423141-5263-4abe-8737-5e51d479db03 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1507 microversion: 2.1 time: 0.509825 Apr 16 16:52:02.367143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 189/349] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:01 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:02.409403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c4c86593-419d-450f-972b-bd5a952de239 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:02.410071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c4c86593-419d-450f-972b-bd5a952de239 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:02.423857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4c86593-419d-450f-972b-bd5a952de239 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:02.424428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4c86593-419d-450f-972b-bd5a952de239 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:02.425489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4c86593-419d-450f-972b-bd5a952de239 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:02.429099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c4c86593-419d-450f-972b-bd5a952de239 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:02.450744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9f5413e4-8f7f-40d3-8406-8e785fe0c70b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:02.451795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9f5413e4-8f7f-40d3-8406-8e785fe0c70b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:02.475964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f5413e4-8f7f-40d3-8406-8e785fe0c70b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:02.476475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f5413e4-8f7f-40d3-8406-8e785fe0c70b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:02.477342 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f5413e4-8f7f-40d3-8406-8e785fe0c70b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:02.477836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f5413e4-8f7f-40d3-8406-8e785fe0c70b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:02.673739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9f5413e4-8f7f-40d3-8406-8e785fe0c70b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 37478 microversion: 2.1 time: 0.226697 Apr 16 16:52:02.676891 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 190/350] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:52:02 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 37478 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:52:02.754958 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-eac105eb-7d68-4b6d-af53-5bc9fbd6fbef tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:02.755745 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-eac105eb-7d68-4b6d-af53-5bc9fbd6fbef tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:02.768474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eac105eb-7d68-4b6d-af53-5bc9fbd6fbef tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:02.769316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eac105eb-7d68-4b6d-af53-5bc9fbd6fbef tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:02.770272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eac105eb-7d68-4b6d-af53-5bc9fbd6fbef tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:02.770800 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eac105eb-7d68-4b6d-af53-5bc9fbd6fbef tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:02.905116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c4c86593-419d-450f-972b-bd5a952de239 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:02.918846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c4c86593-419d-450f-972b-bd5a952de239 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.515289 Apr 16 16:52:02.926308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 161/351] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:02 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:02.942425 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c17f0710-6bc3-4629-be85-64000b90b03c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:02.943121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c17f0710-6bc3-4629-be85-64000b90b03c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:02.959642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c17f0710-6bc3-4629-be85-64000b90b03c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:02.961406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c17f0710-6bc3-4629-be85-64000b90b03c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:02.962840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c17f0710-6bc3-4629-be85-64000b90b03c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:02.963613 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c17f0710-6bc3-4629-be85-64000b90b03c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:03.236689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c17f0710-6bc3-4629-be85-64000b90b03c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:03.251081 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c17f0710-6bc3-4629-be85-64000b90b03c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1280 microversion: 2.1 time: 0.313809 Apr 16 16:52:03.251718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 162/352] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:02 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1280 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:03.385046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b42fd4b6-47a1-49e1-9307-0e1ac65aa1f9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:03.385725 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b42fd4b6-47a1-49e1-9307-0e1ac65aa1f9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:03.396699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b42fd4b6-47a1-49e1-9307-0e1ac65aa1f9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:03.397807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b42fd4b6-47a1-49e1-9307-0e1ac65aa1f9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:03.398877 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b42fd4b6-47a1-49e1-9307-0e1ac65aa1f9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:03.399545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b42fd4b6-47a1-49e1-9307-0e1ac65aa1f9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:03.491578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-eac105eb-7d68-4b6d-af53-5bc9fbd6fbef tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:03.500655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-eac105eb-7d68-4b6d-af53-5bc9fbd6fbef tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.750377 Apr 16 16:52:03.501893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 191/353] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:02 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:03.690214 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9e9a2a8a-3918-41e1-87d7-37bbec1c4ed1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:03.691299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9e9a2a8a-3918-41e1-87d7-37bbec1c4ed1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:03.730909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9e9a2a8a-3918-41e1-87d7-37bbec1c4ed1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:03.732134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9e9a2a8a-3918-41e1-87d7-37bbec1c4ed1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:03.733625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9e9a2a8a-3918-41e1-87d7-37bbec1c4ed1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:03.734311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9e9a2a8a-3918-41e1-87d7-37bbec1c4ed1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:03.883974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9e9a2a8a-3918-41e1-87d7-37bbec1c4ed1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 37856 microversion: 2.1 time: 0.198318 Apr 16 16:52:03.890040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 192/354] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:52:03 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 37856 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:52:03.945847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5ebb0307-1cff-4a46-a3b0-948501cfb305 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:03.946877 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5ebb0307-1cff-4a46-a3b0-948501cfb305 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:03.957232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5ebb0307-1cff-4a46-a3b0-948501cfb305 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:03.957867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5ebb0307-1cff-4a46-a3b0-948501cfb305 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:03.958905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5ebb0307-1cff-4a46-a3b0-948501cfb305 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:03.959527 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5ebb0307-1cff-4a46-a3b0-948501cfb305 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:04.020165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b42fd4b6-47a1-49e1-9307-0e1ac65aa1f9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:04.032817 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b42fd4b6-47a1-49e1-9307-0e1ac65aa1f9 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1507 microversion: 2.1 time: 0.651740 Apr 16 16:52:04.040243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 163/355] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:03 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:04.270696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5d24978a-37c9-4307-b8df-5738cc11016d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:04.271382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5d24978a-37c9-4307-b8df-5738cc11016d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:04.279700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5d24978a-37c9-4307-b8df-5738cc11016d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:04.280210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5d24978a-37c9-4307-b8df-5738cc11016d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:04.281064 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5d24978a-37c9-4307-b8df-5738cc11016d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:04.281555 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5d24978a-37c9-4307-b8df-5738cc11016d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:04.532902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5ebb0307-1cff-4a46-a3b0-948501cfb305 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:04.542882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5ebb0307-1cff-4a46-a3b0-948501cfb305 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.602831 Apr 16 16:52:04.543408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 193/356] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:03 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:04.548804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-403180ef-7ed0-41c5-9b89-ab248997b5e4 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:04.549697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-403180ef-7ed0-41c5-9b89-ab248997b5e4 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:04.557876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-403180ef-7ed0-41c5-9b89-ab248997b5e4 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:04.558408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-403180ef-7ed0-41c5-9b89-ab248997b5e4 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:04.559256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-403180ef-7ed0-41c5-9b89-ab248997b5e4 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:04.559742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-403180ef-7ed0-41c5-9b89-ab248997b5e4 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:04.901346 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5d24978a-37c9-4307-b8df-5738cc11016d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:04.915729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5d24978a-37c9-4307-b8df-5738cc11016d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.650337 Apr 16 16:52:04.916466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 164/357] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:04 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:04.921998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0f7093c5-2400-4151-90fc-b7381ef81f7d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:04.923531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0f7093c5-2400-4151-90fc-b7381ef81f7d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:04.938349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f7093c5-2400-4151-90fc-b7381ef81f7d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:04.938860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f7093c5-2400-4151-90fc-b7381ef81f7d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:04.939714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f7093c5-2400-4151-90fc-b7381ef81f7d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:04.941198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f7093c5-2400-4151-90fc-b7381ef81f7d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:05.071770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-403180ef-7ed0-41c5-9b89-ab248997b5e4 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:05.075614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0f7093c5-2400-4151-90fc-b7381ef81f7d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 38142 microversion: 2.1 time: 0.157214 Apr 16 16:52:05.077307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 165/358] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:52:04 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 38142 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:52:05.085214 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-403180ef-7ed0-41c5-9b89-ab248997b5e4 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.540534 Apr 16 16:52:05.085837 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 194/359] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:04 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:05.086315 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6a43a5ff-4177-4369-bb00-8c37d70cd2a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:05.087259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6a43a5ff-4177-4369-bb00-8c37d70cd2a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:05.095907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6a43a5ff-4177-4369-bb00-8c37d70cd2a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:05.097461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6a43a5ff-4177-4369-bb00-8c37d70cd2a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:05.098704 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6a43a5ff-4177-4369-bb00-8c37d70cd2a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:05.099358 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6a43a5ff-4177-4369-bb00-8c37d70cd2a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:05.325627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6a43a5ff-4177-4369-bb00-8c37d70cd2a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:05.336751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6a43a5ff-4177-4369-bb00-8c37d70cd2a4 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1465 microversion: 2.1 time: 0.257990 Apr 16 16:52:05.337520 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 166/360] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:05 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1465 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:05.561268 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0dd0c6fb-5b92-4e9c-b64d-f9f3675fdae0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:05.562674 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0dd0c6fb-5b92-4e9c-b64d-f9f3675fdae0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:05.573104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0dd0c6fb-5b92-4e9c-b64d-f9f3675fdae0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:05.573937 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0dd0c6fb-5b92-4e9c-b64d-f9f3675fdae0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:05.575046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0dd0c6fb-5b92-4e9c-b64d-f9f3675fdae0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:05.575724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0dd0c6fb-5b92-4e9c-b64d-f9f3675fdae0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:05.716403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-209748dd-5291-4feb-9cca-f49ca8ef1417 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:05.717173 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-209748dd-5291-4feb-9cca-f49ca8ef1417 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:05.729474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-209748dd-5291-4feb-9cca-f49ca8ef1417 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:05.730081 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-209748dd-5291-4feb-9cca-f49ca8ef1417 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:05.732239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-209748dd-5291-4feb-9cca-f49ca8ef1417 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:05.732383 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-209748dd-5291-4feb-9cca-f49ca8ef1417 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:05.825421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-209748dd-5291-4feb-9cca-f49ca8ef1417 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lazy-loading 'flavor' on Instance uuid bf021fce-d230-4117-992c-f91cd978276c {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:52:06.160921 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0dd0c6fb-5b92-4e9c-b64d-f9f3675fdae0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:06.172709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0dd0c6fb-5b92-4e9c-b64d-f9f3675fdae0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.615793 Apr 16 16:52:06.173627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 195/361] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:05 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:06.180018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-8be945fc-1158-4296-9895-09544a95ab25 req-2fafc9f6-8889-4173-8196-9ecae1aeab35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef2f5fa-47be-4da0-8eb6-ff5beff781ca", "name": "network-vif-deleted", "tag": "6c5fa1ae-9c04-448f-99c7-0e4d8fd5c02e"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:06.182403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:52:06.182403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:52:06.194584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-8be945fc-1158-4296-9895-09544a95ab25 req-2fafc9f6-8889-4173-8196-9ecae1aeab35 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:06.195425 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-8be945fc-1158-4296-9895-09544a95ab25 req-2fafc9f6-8889-4173-8196-9ecae1aeab35 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:06.215691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-8be945fc-1158-4296-9895-09544a95ab25 req-2fafc9f6-8889-4173-8196-9ecae1aeab35 service nova] Creating event network-vif-deleted:6c5fa1ae-9c04-448f-99c7-0e4d8fd5c02e for instance bef2f5fa-47be-4da0-8eb6-ff5beff781ca on hv-cinder-73362 Apr 16 16:52:06.222345 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-8be945fc-1158-4296-9895-09544a95ab25 req-2fafc9f6-8889-4173-8196-9ecae1aeab35 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046191 Apr 16 16:52:06.223435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 196/362] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:52:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:06.230788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0bae5e6d-b068-4061-8b8d-ea29b952e543 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:06.231568 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0bae5e6d-b068-4061-8b8d-ea29b952e543 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:06.240882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0bae5e6d-b068-4061-8b8d-ea29b952e543 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:06.241434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0bae5e6d-b068-4061-8b8d-ea29b952e543 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:06.242317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0bae5e6d-b068-4061-8b8d-ea29b952e543 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:06.242812 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0bae5e6d-b068-4061-8b8d-ea29b952e543 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:06.455753 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-209748dd-5291-4feb-9cca-f49ca8ef1417 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 202 len: 0 microversion: 2.20 time: 0.743198 Apr 16 16:52:06.457145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 167/363] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:52:05 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 16 16:52:06.463017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-15bb35ba-7e44-4a1e-bd62-a830d5d977ea tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:06.464198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-15bb35ba-7e44-4a1e-bd62-a830d5d977ea tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:06.473241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-15bb35ba-7e44-4a1e-bd62-a830d5d977ea tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:06.473580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-15bb35ba-7e44-4a1e-bd62-a830d5d977ea tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:06.474434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-15bb35ba-7e44-4a1e-bd62-a830d5d977ea tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:06.474922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-15bb35ba-7e44-4a1e-bd62-a830d5d977ea tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:06.633249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-15bb35ba-7e44-4a1e-bd62-a830d5d977ea tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 200 len: 38249 microversion: 2.1 time: 0.174583 Apr 16 16:52:06.639676 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 168/364] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:52:06 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 38249 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:52:06.641306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-80f132ab-a75f-4723-8d0b-be032e50b1e3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:06.642130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-80f132ab-a75f-4723-8d0b-be032e50b1e3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:06.655406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80f132ab-a75f-4723-8d0b-be032e50b1e3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:06.655911 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80f132ab-a75f-4723-8d0b-be032e50b1e3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:06.656760 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80f132ab-a75f-4723-8d0b-be032e50b1e3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:06.657253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80f132ab-a75f-4723-8d0b-be032e50b1e3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:06.734719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0bae5e6d-b068-4061-8b8d-ea29b952e543 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:06.749291 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0bae5e6d-b068-4061-8b8d-ea29b952e543 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.522228 Apr 16 16:52:06.750336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 197/365] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:06 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:06.755493 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:06.756161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:06.793475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:06.793475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:06.794153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:06.794722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:06.877478 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:06.878277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:06.878849 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lazy-loading 'fault' on Instance uuid bef2f5fa-47be-4da0-8eb6-ff5beff781ca {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:52:07.005953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba3fd35d4ec74a419ff480b118cefaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f124676424457a8eb80eafbc0b97d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:07.015200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2ae05957-8d4f-42f3-ae73-9bcc6684b5eb tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 200 len: 1307 microversion: 2.1 time: 0.263751 Apr 16 16:52:07.015834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 198/366] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:06 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 1307 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:07.021551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-218539356", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-198386243", "security_groups": [{"name": "tempest-secgroup-smoke-55705316"}], "networks": [{"uuid": "ea13a159-05d1-4d6a-8a0b-c632af69c3bf"}], "block_device_mapping_v2": [{"uuid": "c831f61a-e027-44ba-8474-b0473778ad34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:07.270772 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-80f132ab-a75f-4723-8d0b-be032e50b1e3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:07.280129 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-80f132ab-a75f-4723-8d0b-be032e50b1e3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.644655 Apr 16 16:52:07.280762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 169/367] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:06 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:07.286446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-deb3c8c1-09fd-4870-bac9-5892c69b0032 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:07.287112 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-deb3c8c1-09fd-4870-bac9-5892c69b0032 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:07.295115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-deb3c8c1-09fd-4870-bac9-5892c69b0032 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:07.295706 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-deb3c8c1-09fd-4870-bac9-5892c69b0032 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:07.296596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-deb3c8c1-09fd-4870-bac9-5892c69b0032 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:07.297067 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-deb3c8c1-09fd-4870-bac9-5892c69b0032 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:07.367219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] validate_networks() for [('ea13a159-05d1-4d6a-8a0b-c632af69c3bf', None, None, None)] {{(pid=99398) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:52:07.819995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-deb3c8c1-09fd-4870-bac9-5892c69b0032 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:07.835526 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-deb3c8c1-09fd-4870-bac9-5892c69b0032 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:07.837232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-deb3c8c1-09fd-4870-bac9-5892c69b0032 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:07.838507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-deb3c8c1-09fd-4870-bac9-5892c69b0032 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.556715 Apr 16 16:52:07.839329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 170/368] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:07 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:07.847322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-fe7367f0-1521-4a9d-94a6-3522377bf454 req-bc192fdc-4a7e-44a7-ae52-208177d7078d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "352dbe2a-d325-41eb-808c-36a4534b171b", "tag": "51b8feb1-4963-4f27-81af-59dd11a082f7"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:07.847753 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:52:07.847753 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:52:07.861172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-fe7367f0-1521-4a9d-94a6-3522377bf454 req-bc192fdc-4a7e-44a7-ae52-208177d7078d service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:07.861703 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-fe7367f0-1521-4a9d-94a6-3522377bf454 req-bc192fdc-4a7e-44a7-ae52-208177d7078d service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:07.884769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-fe7367f0-1521-4a9d-94a6-3522377bf454 req-bc192fdc-4a7e-44a7-ae52-208177d7078d service nova] Creating event network-changed:51b8feb1-4963-4f27-81af-59dd11a082f7 for instance 352dbe2a-d325-41eb-808c-36a4534b171b on hv-cinder-73362 Apr 16 16:52:07.890034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-fe7367f0-1521-4a9d-94a6-3522377bf454 req-bc192fdc-4a7e-44a7-ae52-208177d7078d service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049525 Apr 16 16:52:07.891087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 171/369] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:52:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:07.897712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1ecf1c8d-ac31-4abf-97df-c553c33f27aa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:07.897922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1ecf1c8d-ac31-4abf-97df-c553c33f27aa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:07.906823 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ecf1c8d-ac31-4abf-97df-c553c33f27aa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:07.907223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ecf1c8d-ac31-4abf-97df-c553c33f27aa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:07.908508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ecf1c8d-ac31-4abf-97df-c553c33f27aa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:07.909748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1ecf1c8d-ac31-4abf-97df-c553c33f27aa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:07.985314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1ecf1c8d-ac31-4abf-97df-c553c33f27aa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/ips" status: 200 len: 146 microversion: 2.1 time: 0.093218 Apr 16 16:52:07.985930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 172/370] 10.222.0.103 () {58 vars in 1243 bytes} [Fri Apr 16 16:52:07 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/ips => generated 146 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:07.993038 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2548316c-7040-4fd0-b35c-f63326044433 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:07.993646 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2548316c-7040-4fd0-b35c-f63326044433 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:08.006694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2548316c-7040-4fd0-b35c-f63326044433 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:08.007318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2548316c-7040-4fd0-b35c-f63326044433 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:08.008269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2548316c-7040-4fd0-b35c-f63326044433 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:08.008850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2548316c-7040-4fd0-b35c-f63326044433 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:08.838716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2548316c-7040-4fd0-b35c-f63326044433 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:08.848429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2548316c-7040-4fd0-b35c-f63326044433 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.861174 Apr 16 16:52:08.849071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 173/371] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:07 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:08.853857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c483c69f-b971-4718-816b-3b2a81f4c696 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:08.854540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c483c69f-b971-4718-816b-3b2a81f4c696 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:08.857031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Flavor limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:52:08.857986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Image limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:52:08.858630 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Flavor pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:52:08.859094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Image pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:52:08.859561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:52:08.863569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c483c69f-b971-4718-816b-3b2a81f4c696 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:08.864067 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c483c69f-b971-4718-816b-3b2a81f4c696 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:08.864918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c483c69f-b971-4718-816b-3b2a81f4c696 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:08.865399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c483c69f-b971-4718-816b-3b2a81f4c696 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:08.870271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:08.870922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:08.871799 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:08.872291 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:08.892040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Getting quotas for project 36e2bc75e4e1400fab18b3944402fa76. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:52:08.897057 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Getting quotas for user 095c903e1e3747aa8c7201ca585aef54 and project 36e2bc75e4e1400fab18b3944402fa76. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:52:09.021397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Going to run 1 instances... {{(pid=99398) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:52:09.023825 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c831f61a-e027-44ba-8474-b0473778ad34',volume_size=None,volume_type=None)] {{(pid=99398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:52:09.239678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ce47707a-2e83-413c-ab28-76114a34526e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.222672 Apr 16 16:52:09.240387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 199/372] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:52:07 2021] POST /compute/v2.1/servers => generated 406 bytes in 2224 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:52:09.250824 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2d9e932b-0ccf-4e2f-87aa-5a2abbbd32e5 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:09.251497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2d9e932b-0ccf-4e2f-87aa-5a2abbbd32e5 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] [instance: bef2f5fa-47be-4da0-8eb6-ff5beff781ca] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:09.261026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d9e932b-0ccf-4e2f-87aa-5a2abbbd32e5 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.261631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d9e932b-0ccf-4e2f-87aa-5a2abbbd32e5 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:09.262512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d9e932b-0ccf-4e2f-87aa-5a2abbbd32e5 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.263001 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d9e932b-0ccf-4e2f-87aa-5a2abbbd32e5 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:09.320982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-2d9e932b-0ccf-4e2f-87aa-5a2abbbd32e5 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] HTTP exception thrown: Instance bef2f5fa-47be-4da0-8eb6-ff5beff781ca could not be found. Apr 16 16:52:09.321663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2d9e932b-0ccf-4e2f-87aa-5a2abbbd32e5 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] Returning 404 to user: Instance bef2f5fa-47be-4da0-8eb6-ff5beff781ca could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:52:09.322614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2d9e932b-0ccf-4e2f-87aa-5a2abbbd32e5 tempest-VolumesActionsTest-743576464 tempest-VolumesActionsTest-743576464-project] 10.222.0.103 "GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca" status: 404 len: 111 microversion: 2.1 time: 0.075850 Apr 16 16:52:09.326233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c483c69f-b971-4718-816b-3b2a81f4c696 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:09.330168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 200/373] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:09 2021] GET /compute/v2.1/servers/bef2f5fa-47be-4da0-8eb6-ff5beff781ca => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:52:09.337756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-0df77239-b847-4db5-a18f-c7dcd58dd971 req-137c0964-a16a-44ab-939f-bb6d58f9077a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500baa3d-78d8-4008-afc2-d49d5aaa1020", "tag": "2d48f720-4baa-45ca-8271-4398ebd12575"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:09.340994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:52:09.340994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:52:09.344927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c483c69f-b971-4718-816b-3b2a81f4c696 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.494353 Apr 16 16:52:09.346620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 174/374] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:08 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:09.352295 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fdb48509-a1e6-42c1-a65c-c612c8c21a24 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:09.353217 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fdb48509-a1e6-42c1-a65c-c612c8c21a24 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:09.358153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-0df77239-b847-4db5-a18f-c7dcd58dd971 req-137c0964-a16a-44ab-939f-bb6d58f9077a service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.358644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-0df77239-b847-4db5-a18f-c7dcd58dd971 req-137c0964-a16a-44ab-939f-bb6d58f9077a service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:09.362906 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdb48509-a1e6-42c1-a65c-c612c8c21a24 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.363732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdb48509-a1e6-42c1-a65c-c612c8c21a24 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:09.364803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdb48509-a1e6-42c1-a65c-c612c8c21a24 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.365588 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdb48509-a1e6-42c1-a65c-c612c8c21a24 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:09.385603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-0df77239-b847-4db5-a18f-c7dcd58dd971 req-137c0964-a16a-44ab-939f-bb6d58f9077a service nova] Creating event network-changed:2d48f720-4baa-45ca-8271-4398ebd12575 for instance 500baa3d-78d8-4008-afc2-d49d5aaa1020 on hv-cinder-73362 Apr 16 16:52:09.391003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-0df77239-b847-4db5-a18f-c7dcd58dd971 req-137c0964-a16a-44ab-939f-bb6d58f9077a service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058183 Apr 16 16:52:09.392072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 201/375] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:52:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:09.399962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-91c30a37-ff51-4bf7-9f66-8065a63b77ff tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:09.402256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-91c30a37-ff51-4bf7-9f66-8065a63b77ff tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:09.412046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-91c30a37-ff51-4bf7-9f66-8065a63b77ff tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.412548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-91c30a37-ff51-4bf7-9f66-8065a63b77ff tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:09.413401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-91c30a37-ff51-4bf7-9f66-8065a63b77ff tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.413892 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-91c30a37-ff51-4bf7-9f66-8065a63b77ff tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:09.898172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-91c30a37-ff51-4bf7-9f66-8065a63b77ff tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:09.904909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fdb48509-a1e6-42c1-a65c-c612c8c21a24 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:09.909555 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-91c30a37-ff51-4bf7-9f66-8065a63b77ff tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:09.911951 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-91c30a37-ff51-4bf7-9f66-8065a63b77ff tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:09.913418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-91c30a37-ff51-4bf7-9f66-8065a63b77ff tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.517940 Apr 16 16:52:09.914400 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 202/376] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:09 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:09.922660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fdb48509-a1e6-42c1-a65c-c612c8c21a24 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.574545 Apr 16 16:52:09.926788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 175/377] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:09 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:09.930707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3cb7bbe5-b3ab-4efe-a023-4a610167ea58 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:09.931632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3cb7bbe5-b3ab-4efe-a023-4a610167ea58 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:09.933914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d8ad832f-9089-484e-9de9-62cf3d6bd799 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:09.934859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d8ad832f-9089-484e-9de9-62cf3d6bd799 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:09.944489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d8ad832f-9089-484e-9de9-62cf3d6bd799 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.945326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d8ad832f-9089-484e-9de9-62cf3d6bd799 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:09.946346 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d8ad832f-9089-484e-9de9-62cf3d6bd799 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.946750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3cb7bbe5-b3ab-4efe-a023-4a610167ea58 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.947156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d8ad832f-9089-484e-9de9-62cf3d6bd799 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:09.947282 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3cb7bbe5-b3ab-4efe-a023-4a610167ea58 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:09.948107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3cb7bbe5-b3ab-4efe-a023-4a610167ea58 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:09.948609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3cb7bbe5-b3ab-4efe-a023-4a610167ea58 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:10.244569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3cb7bbe5-b3ab-4efe-a023-4a610167ea58 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:10.273643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3cb7bbe5-b3ab-4efe-a023-4a610167ea58 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1132 microversion: 2.1 time: 0.357845 Apr 16 16:52:10.278595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 203/378] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:09 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1132 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:10.348662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d8ad832f-9089-484e-9de9-62cf3d6bd799 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:10.361185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d8ad832f-9089-484e-9de9-62cf3d6bd799 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.432589 Apr 16 16:52:10.362874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 176/379] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:09 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:10.365270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6cb2c1d9-2f22-43fd-84cd-71dbf7e607a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:10.365953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6cb2c1d9-2f22-43fd-84cd-71dbf7e607a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:10.373995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6cb2c1d9-2f22-43fd-84cd-71dbf7e607a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:10.374965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6cb2c1d9-2f22-43fd-84cd-71dbf7e607a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:10.375332 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6cb2c1d9-2f22-43fd-84cd-71dbf7e607a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:10.375834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6cb2c1d9-2f22-43fd-84cd-71dbf7e607a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:10.683141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6cb2c1d9-2f22-43fd-84cd-71dbf7e607a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:10.695404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6cb2c1d9-2f22-43fd-84cd-71dbf7e607a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.335906 Apr 16 16:52:10.705286 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 204/380] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:10 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:10.944252 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0eabab40-e11f-4db5-bbab-c3021a09b923 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:10.944847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4a145e4c-0e5e-487d-aa83-9fd749f143e8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:10.944988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0eabab40-e11f-4db5-bbab-c3021a09b923 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:10.945104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4a145e4c-0e5e-487d-aa83-9fd749f143e8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:10.953306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0eabab40-e11f-4db5-bbab-c3021a09b923 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:10.953820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0eabab40-e11f-4db5-bbab-c3021a09b923 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:10.954432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4a145e4c-0e5e-487d-aa83-9fd749f143e8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:10.954780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0eabab40-e11f-4db5-bbab-c3021a09b923 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:10.955103 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4a145e4c-0e5e-487d-aa83-9fd749f143e8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:10.955258 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0eabab40-e11f-4db5-bbab-c3021a09b923 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:10.956177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4a145e4c-0e5e-487d-aa83-9fd749f143e8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:10.956743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4a145e4c-0e5e-487d-aa83-9fd749f143e8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:11.406214 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0eabab40-e11f-4db5-bbab-c3021a09b923 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:11.413230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4a145e4c-0e5e-487d-aa83-9fd749f143e8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:11.429953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4a145e4c-0e5e-487d-aa83-9fd749f143e8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.490511 Apr 16 16:52:11.432170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 205/381] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:10 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:11.443385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b2ce61a3-6b3c-45bf-ace2-475ab2d7cdaf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:11.444610 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b2ce61a3-6b3c-45bf-ace2-475ab2d7cdaf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:11.453067 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b2ce61a3-6b3c-45bf-ace2-475ab2d7cdaf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:11.453864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b2ce61a3-6b3c-45bf-ace2-475ab2d7cdaf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:11.454923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b2ce61a3-6b3c-45bf-ace2-475ab2d7cdaf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:11.456116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b2ce61a3-6b3c-45bf-ace2-475ab2d7cdaf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:11.457075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0eabab40-e11f-4db5-bbab-c3021a09b923 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:11.459836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0eabab40-e11f-4db5-bbab-c3021a09b923 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:11.466474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0eabab40-e11f-4db5-bbab-c3021a09b923 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.530700 Apr 16 16:52:11.478307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 177/382] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:10 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:11.481557 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1a0491d4-d92e-48db-bc80-d8dbf0a0de24 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:11.482253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1a0491d4-d92e-48db-bc80-d8dbf0a0de24 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:11.502311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1a0491d4-d92e-48db-bc80-d8dbf0a0de24 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:11.503327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1a0491d4-d92e-48db-bc80-d8dbf0a0de24 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:11.504180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1a0491d4-d92e-48db-bc80-d8dbf0a0de24 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:11.504668 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1a0491d4-d92e-48db-bc80-d8dbf0a0de24 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:11.712401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b2ce61a3-6b3c-45bf-ace2-475ab2d7cdaf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:11.722335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b2ce61a3-6b3c-45bf-ace2-475ab2d7cdaf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1206 microversion: 2.1 time: 0.287834 Apr 16 16:52:11.731352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 206/383] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:11 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1206 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:11.731352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e5b0c510-c7b1-47c7-9341-59ab04b3d75a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:11.731352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e5b0c510-c7b1-47c7-9341-59ab04b3d75a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:11.739441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e5b0c510-c7b1-47c7-9341-59ab04b3d75a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:11.740047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e5b0c510-c7b1-47c7-9341-59ab04b3d75a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:11.740998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e5b0c510-c7b1-47c7-9341-59ab04b3d75a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:11.741576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e5b0c510-c7b1-47c7-9341-59ab04b3d75a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:11.886982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1a0491d4-d92e-48db-bc80-d8dbf0a0de24 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:11.898878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1a0491d4-d92e-48db-bc80-d8dbf0a0de24 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.428826 Apr 16 16:52:11.910400 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 178/384] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:11 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:11.926780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-eda5f2d1-992a-4eaa-b8f2-028dee9910cc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f30bf2b-a970-40fb-9028-49e69ac57bfe"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:11.927960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-eda5f2d1-992a-4eaa-b8f2-028dee9910cc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:11.935882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eda5f2d1-992a-4eaa-b8f2-028dee9910cc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:11.936459 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eda5f2d1-992a-4eaa-b8f2-028dee9910cc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:11.937216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eda5f2d1-992a-4eaa-b8f2-028dee9910cc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:11.937710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eda5f2d1-992a-4eaa-b8f2-028dee9910cc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:11.983902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e5b0c510-c7b1-47c7-9341-59ab04b3d75a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:11.995359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e5b0c510-c7b1-47c7-9341-59ab04b3d75a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.270363 Apr 16 16:52:11.996343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 207/385] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:11 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:12.459117 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1de79f15-d306-4060-adb1-41d45b0f54cf tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:12.466113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1de79f15-d306-4060-adb1-41d45b0f54cf tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:12.474959 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1de79f15-d306-4060-adb1-41d45b0f54cf tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:12.475472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1de79f15-d306-4060-adb1-41d45b0f54cf tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:12.476325 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1de79f15-d306-4060-adb1-41d45b0f54cf tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:12.476794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1de79f15-d306-4060-adb1-41d45b0f54cf tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:12.704797 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1de79f15-d306-4060-adb1-41d45b0f54cf tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:12.714604 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1de79f15-d306-4060-adb1-41d45b0f54cf tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.261430 Apr 16 16:52:12.715230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 208/386] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:12 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:12.719946 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-45617a9c-297d-4f24-a43b-f687c22fc348 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:12.720618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-45617a9c-297d-4f24-a43b-f687c22fc348 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:12.728565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45617a9c-297d-4f24-a43b-f687c22fc348 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:12.729084 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45617a9c-297d-4f24-a43b-f687c22fc348 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:12.730214 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45617a9c-297d-4f24-a43b-f687c22fc348 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:12.730666 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45617a9c-297d-4f24-a43b-f687c22fc348 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:12.947642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-45617a9c-297d-4f24-a43b-f687c22fc348 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:12.958362 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-45617a9c-297d-4f24-a43b-f687c22fc348 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:12.960235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-45617a9c-297d-4f24-a43b-f687c22fc348 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:12.961574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-45617a9c-297d-4f24-a43b-f687c22fc348 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.245352 Apr 16 16:52:12.971903 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 209/387] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:12 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:12.976941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-137423b6-0e6c-4c2e-bdcc-4a1c55ace3b2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:12.977628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-137423b6-0e6c-4c2e-bdcc-4a1c55ace3b2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:12.985915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-137423b6-0e6c-4c2e-bdcc-4a1c55ace3b2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:12.986499 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-137423b6-0e6c-4c2e-bdcc-4a1c55ace3b2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:12.988015 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-137423b6-0e6c-4c2e-bdcc-4a1c55ace3b2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:12.988543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-137423b6-0e6c-4c2e-bdcc-4a1c55ace3b2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:13.210378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-137423b6-0e6c-4c2e-bdcc-4a1c55ace3b2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:13.219521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-137423b6-0e6c-4c2e-bdcc-4a1c55ace3b2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1272 microversion: 2.1 time: 0.246476 Apr 16 16:52:13.220310 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 210/388] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:12 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:13.225712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0da7b19a-6b4a-41aa-ae15-4bf36704f162 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:13.226382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0da7b19a-6b4a-41aa-ae15-4bf36704f162 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:13.234050 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0da7b19a-6b4a-41aa-ae15-4bf36704f162 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:13.234581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0da7b19a-6b4a-41aa-ae15-4bf36704f162 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:13.235413 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0da7b19a-6b4a-41aa-ae15-4bf36704f162 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:13.235897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0da7b19a-6b4a-41aa-ae15-4bf36704f162 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:13.463890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0da7b19a-6b4a-41aa-ae15-4bf36704f162 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:13.473620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0da7b19a-6b4a-41aa-ae15-4bf36704f162 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.252249 Apr 16 16:52:13.474241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 211/389] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:13 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:13.479096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9a9157bd-f85a-4f0f-83dc-026086a306c0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:13.479750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9a9157bd-f85a-4f0f-83dc-026086a306c0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:13.488369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9a9157bd-f85a-4f0f-83dc-026086a306c0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:13.488871 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9a9157bd-f85a-4f0f-83dc-026086a306c0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:13.489707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9a9157bd-f85a-4f0f-83dc-026086a306c0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:13.490188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9a9157bd-f85a-4f0f-83dc-026086a306c0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:13.707314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9a9157bd-f85a-4f0f-83dc-026086a306c0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:13.716180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9a9157bd-f85a-4f0f-83dc-026086a306c0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.240617 Apr 16 16:52:13.716718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 212/390] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:13 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:13.732206 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e25abcc0-ce07-47a9-99af-628e578b8e4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:13.732872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e25abcc0-ce07-47a9-99af-628e578b8e4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:13.740704 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e25abcc0-ce07-47a9-99af-628e578b8e4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:13.741211 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e25abcc0-ce07-47a9-99af-628e578b8e4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:13.742044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e25abcc0-ce07-47a9-99af-628e578b8e4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:13.742591 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e25abcc0-ce07-47a9-99af-628e578b8e4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:13.966728 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e25abcc0-ce07-47a9-99af-628e578b8e4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:13.976656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e25abcc0-ce07-47a9-99af-628e578b8e4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.248188 Apr 16 16:52:13.977270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 213/391] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:13 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:13.991860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-119d3f4f-771f-4f26-8fd9-1a77e9bcd540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:13.992523 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-119d3f4f-771f-4f26-8fd9-1a77e9bcd540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:14.000372 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-119d3f4f-771f-4f26-8fd9-1a77e9bcd540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:14.000881 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-119d3f4f-771f-4f26-8fd9-1a77e9bcd540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:14.001723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-119d3f4f-771f-4f26-8fd9-1a77e9bcd540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:14.002260 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-119d3f4f-771f-4f26-8fd9-1a77e9bcd540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:14.223625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-119d3f4f-771f-4f26-8fd9-1a77e9bcd540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:14.233129 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-119d3f4f-771f-4f26-8fd9-1a77e9bcd540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:14.235150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-119d3f4f-771f-4f26-8fd9-1a77e9bcd540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:14.236368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-119d3f4f-771f-4f26-8fd9-1a77e9bcd540 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.249289 Apr 16 16:52:14.237662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 214/392] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:13 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:52:14.242388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-025698bc-0a2b-4b05-8f15-d394e5b50324 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:14.243047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-025698bc-0a2b-4b05-8f15-d394e5b50324 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:14.250732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-025698bc-0a2b-4b05-8f15-d394e5b50324 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:14.251235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-025698bc-0a2b-4b05-8f15-d394e5b50324 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:14.252062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-025698bc-0a2b-4b05-8f15-d394e5b50324 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:14.252551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-025698bc-0a2b-4b05-8f15-d394e5b50324 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:14.475677 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-025698bc-0a2b-4b05-8f15-d394e5b50324 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:14.484905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-025698bc-0a2b-4b05-8f15-d394e5b50324 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1272 microversion: 2.1 time: 0.246225 Apr 16 16:52:14.485533 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 215/393] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:14 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:14.491875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bf3e664d-ad1d-42a2-abfd-1391cb723537 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:14.492716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bf3e664d-ad1d-42a2-abfd-1391cb723537 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:14.501340 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf3e664d-ad1d-42a2-abfd-1391cb723537 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:14.501846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf3e664d-ad1d-42a2-abfd-1391cb723537 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:14.502763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf3e664d-ad1d-42a2-abfd-1391cb723537 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:14.503255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf3e664d-ad1d-42a2-abfd-1391cb723537 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:14.727451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bf3e664d-ad1d-42a2-abfd-1391cb723537 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:14.736573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bf3e664d-ad1d-42a2-abfd-1391cb723537 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.248459 Apr 16 16:52:14.737205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 216/394] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:14 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:14.741902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-625617cc-7ba9-4c6c-b275-8e517186a584 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:14.742616 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-625617cc-7ba9-4c6c-b275-8e517186a584 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:14.750155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-625617cc-7ba9-4c6c-b275-8e517186a584 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:14.750702 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-625617cc-7ba9-4c6c-b275-8e517186a584 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:14.751539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-625617cc-7ba9-4c6c-b275-8e517186a584 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:14.752031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-625617cc-7ba9-4c6c-b275-8e517186a584 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:14.983720 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-625617cc-7ba9-4c6c-b275-8e517186a584 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:14.997028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-625617cc-7ba9-4c6c-b275-8e517186a584 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.258693 Apr 16 16:52:14.997696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 217/395] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:14 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:15.003282 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4d312874-c691-45d9-aaa1-5293c231b72f tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:15.004000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4d312874-c691-45d9-aaa1-5293c231b72f tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:15.019764 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d312874-c691-45d9-aaa1-5293c231b72f tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:15.021583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d312874-c691-45d9-aaa1-5293c231b72f tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:15.022465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d312874-c691-45d9-aaa1-5293c231b72f tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:15.022973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d312874-c691-45d9-aaa1-5293c231b72f tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:15.262656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-eda5f2d1-992a-4eaa-b8f2-028dee9910cc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.340700 Apr 16 16:52:15.270694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 179/396] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:52:11 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/os-volume_attachments => generated 194 bytes in 3350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:52:15.279272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fff3df69-6f54-428c-be68-452c7907a0d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:15.280254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fff3df69-6f54-428c-be68-452c7907a0d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:15.292107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fff3df69-6f54-428c-be68-452c7907a0d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:15.292850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fff3df69-6f54-428c-be68-452c7907a0d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:15.294036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fff3df69-6f54-428c-be68-452c7907a0d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:15.294751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fff3df69-6f54-428c-be68-452c7907a0d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:15.309232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4d312874-c691-45d9-aaa1-5293c231b72f tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:15.324279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4d312874-c691-45d9-aaa1-5293c231b72f tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.325475 Apr 16 16:52:15.334348 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 218/397] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:14 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:15.503770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b34f00c8-03a7-42e3-998a-30646ffd49f0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:15.504464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b34f00c8-03a7-42e3-998a-30646ffd49f0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:15.522261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b34f00c8-03a7-42e3-998a-30646ffd49f0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:15.523123 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b34f00c8-03a7-42e3-998a-30646ffd49f0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:15.524159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b34f00c8-03a7-42e3-998a-30646ffd49f0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:15.524797 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b34f00c8-03a7-42e3-998a-30646ffd49f0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:15.542193 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fff3df69-6f54-428c-be68-452c7907a0d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:15.554908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fff3df69-6f54-428c-be68-452c7907a0d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:15.556865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fff3df69-6f54-428c-be68-452c7907a0d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:15.558227 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fff3df69-6f54-428c-be68-452c7907a0d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.285948 Apr 16 16:52:15.559121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 180/398] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:15 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:15.755878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ae0db6a7-f57c-4a05-8ad6-cd616e05761f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:15.757984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ae0db6a7-f57c-4a05-8ad6-cd616e05761f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:15.768328 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae0db6a7-f57c-4a05-8ad6-cd616e05761f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:15.768781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b34f00c8-03a7-42e3-998a-30646ffd49f0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:15.769839 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae0db6a7-f57c-4a05-8ad6-cd616e05761f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:15.771139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae0db6a7-f57c-4a05-8ad6-cd616e05761f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:15.772818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae0db6a7-f57c-4a05-8ad6-cd616e05761f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:15.780865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b34f00c8-03a7-42e3-998a-30646ffd49f0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1272 microversion: 2.1 time: 0.281274 Apr 16 16:52:15.781940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 219/399] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:15 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:16.012941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ae0db6a7-f57c-4a05-8ad6-cd616e05761f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:16.025279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ae0db6a7-f57c-4a05-8ad6-cd616e05761f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.274023 Apr 16 16:52:16.031679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-917a5237-153b-4db8-94e5-1ed27c4b0a17 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:16.037670 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-917a5237-153b-4db8-94e5-1ed27c4b0a17 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:16.050723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 181/400] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:15 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:16.054946 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-917a5237-153b-4db8-94e5-1ed27c4b0a17 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:16.055551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-917a5237-153b-4db8-94e5-1ed27c4b0a17 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:16.058015 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-917a5237-153b-4db8-94e5-1ed27c4b0a17 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:16.058627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-917a5237-153b-4db8-94e5-1ed27c4b0a17 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:16.343701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ce185432-15d3-4cc1-b594-1915647600c8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:16.344650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ce185432-15d3-4cc1-b594-1915647600c8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:16.359890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce185432-15d3-4cc1-b594-1915647600c8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:16.363237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce185432-15d3-4cc1-b594-1915647600c8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:16.364350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce185432-15d3-4cc1-b594-1915647600c8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:16.364909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce185432-15d3-4cc1-b594-1915647600c8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:16.462870 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-917a5237-153b-4db8-94e5-1ed27c4b0a17 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:16.474254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-917a5237-153b-4db8-94e5-1ed27c4b0a17 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.453611 Apr 16 16:52:16.489033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 220/401] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:16 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:16.577898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-943fa220-ca89-4059-ae18-053d4528e3f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:16.578592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-943fa220-ca89-4059-ae18-053d4528e3f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:16.595277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-943fa220-ca89-4059-ae18-053d4528e3f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:16.595780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-943fa220-ca89-4059-ae18-053d4528e3f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:16.597131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-943fa220-ca89-4059-ae18-053d4528e3f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:16.597629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-943fa220-ca89-4059-ae18-053d4528e3f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:16.818361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ce185432-15d3-4cc1-b594-1915647600c8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:16.838077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ce185432-15d3-4cc1-b594-1915647600c8 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.498595 Apr 16 16:52:16.839753 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 182/402] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:16 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:16.844922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3d82cd70-5b28-43d6-951e-5d8bd288b534 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:16.850843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3d82cd70-5b28-43d6-951e-5d8bd288b534 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:16.872333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d82cd70-5b28-43d6-951e-5d8bd288b534 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:16.877038 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d82cd70-5b28-43d6-951e-5d8bd288b534 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:16.881553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d82cd70-5b28-43d6-951e-5d8bd288b534 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:16.882822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d82cd70-5b28-43d6-951e-5d8bd288b534 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:17.065389 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-943fa220-ca89-4059-ae18-053d4528e3f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:17.097140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-943fa220-ca89-4059-ae18-053d4528e3f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:17.098916 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-943fa220-ca89-4059-ae18-053d4528e3f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:17.107918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-943fa220-ca89-4059-ae18-053d4528e3f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.534430 Apr 16 16:52:17.110816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 221/403] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:16 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:52:17.123956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-dad4ea23-5a8a-4554-87f1-359aa5b03c78 req-073e2aa7-8db4-40c8-8b42-cc15ed7bf584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5", "tag": "ee6c6c28-4fef-436e-a001-4f66a8ffef9d"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:17.128729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:52:17.128729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:52:17.149958 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-dad4ea23-5a8a-4554-87f1-359aa5b03c78 req-073e2aa7-8db4-40c8-8b42-cc15ed7bf584 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:17.151927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-dad4ea23-5a8a-4554-87f1-359aa5b03c78 req-073e2aa7-8db4-40c8-8b42-cc15ed7bf584 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:17.210929 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-dad4ea23-5a8a-4554-87f1-359aa5b03c78 req-073e2aa7-8db4-40c8-8b42-cc15ed7bf584 service nova] Creating event network-changed:ee6c6c28-4fef-436e-a001-4f66a8ffef9d for instance e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 on hv-cinder-73362 Apr 16 16:52:17.222838 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-dad4ea23-5a8a-4554-87f1-359aa5b03c78 req-073e2aa7-8db4-40c8-8b42-cc15ed7bf584 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106761 Apr 16 16:52:17.223600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 222/404] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:52:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:17.240504 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bd32716e-126f-4aae-99be-22d0507bd34b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:17.244184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bd32716e-126f-4aae-99be-22d0507bd34b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:17.278241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bd32716e-126f-4aae-99be-22d0507bd34b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:17.287119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bd32716e-126f-4aae-99be-22d0507bd34b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:17.289880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bd32716e-126f-4aae-99be-22d0507bd34b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:17.290968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bd32716e-126f-4aae-99be-22d0507bd34b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:17.384857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3d82cd70-5b28-43d6-951e-5d8bd288b534 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:17.415121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3d82cd70-5b28-43d6-951e-5d8bd288b534 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.573663 Apr 16 16:52:17.417264 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 183/405] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:16 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:17.499660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-12242e48-d3d0-4ed2-87dd-3ae2cc4810d0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:17.500473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-12242e48-d3d0-4ed2-87dd-3ae2cc4810d0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:17.512355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-12242e48-d3d0-4ed2-87dd-3ae2cc4810d0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:17.514368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-12242e48-d3d0-4ed2-87dd-3ae2cc4810d0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:17.515466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-12242e48-d3d0-4ed2-87dd-3ae2cc4810d0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:17.516108 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-12242e48-d3d0-4ed2-87dd-3ae2cc4810d0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:17.892803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bd32716e-126f-4aae-99be-22d0507bd34b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:17.904504 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bd32716e-126f-4aae-99be-22d0507bd34b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.676886 Apr 16 16:52:17.905714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 223/406] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:17 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:17.912380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-fce8d574-1178-435b-9eca-b76fea190c9e req-b299fcfc-02cc-4554-bc6a-13b309d611e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500baa3d-78d8-4008-afc2-d49d5aaa1020", "name": "network-vif-plugged", "status": "completed", "tag": "2d48f720-4baa-45ca-8271-4398ebd12575"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:17.913059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-12242e48-d3d0-4ed2-87dd-3ae2cc4810d0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:17.914818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:52:17.914818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:52:17.926967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-12242e48-d3d0-4ed2-87dd-3ae2cc4810d0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.430223 Apr 16 16:52:17.926967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 184/407] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:17 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:17.929450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-fce8d574-1178-435b-9eca-b76fea190c9e req-b299fcfc-02cc-4554-bc6a-13b309d611e5 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:17.930337 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-fce8d574-1178-435b-9eca-b76fea190c9e req-b299fcfc-02cc-4554-bc6a-13b309d611e5 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:17.932467 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-181c5ffc-100c-415e-b92b-927bdc617c4a tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:17.933141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-181c5ffc-100c-415e-b92b-927bdc617c4a tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:17.947178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-181c5ffc-100c-415e-b92b-927bdc617c4a tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:17.948219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-181c5ffc-100c-415e-b92b-927bdc617c4a tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:17.949235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-181c5ffc-100c-415e-b92b-927bdc617c4a tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:17.949875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-181c5ffc-100c-415e-b92b-927bdc617c4a tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:17.953155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-fce8d574-1178-435b-9eca-b76fea190c9e req-b299fcfc-02cc-4554-bc6a-13b309d611e5 service nova] Creating event network-vif-plugged:2d48f720-4baa-45ca-8271-4398ebd12575 for instance 500baa3d-78d8-4008-afc2-d49d5aaa1020 on hv-cinder-73362 Apr 16 16:52:17.959791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-fce8d574-1178-435b-9eca-b76fea190c9e req-b299fcfc-02cc-4554-bc6a-13b309d611e5 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052054 Apr 16 16:52:17.960950 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 224/408] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:52:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:18.130070 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dd1210e0-e0e2-4c30-97ad-987490a8a85a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:18.133436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dd1210e0-e0e2-4c30-97ad-987490a8a85a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:18.152927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dd1210e0-e0e2-4c30-97ad-987490a8a85a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:18.154876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dd1210e0-e0e2-4c30-97ad-987490a8a85a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:18.163051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dd1210e0-e0e2-4c30-97ad-987490a8a85a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:18.164253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dd1210e0-e0e2-4c30-97ad-987490a8a85a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:18.504439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-181c5ffc-100c-415e-b92b-927bdc617c4a tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:18.516768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-181c5ffc-100c-415e-b92b-927bdc617c4a tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.588757 Apr 16 16:52:18.525249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 185/409] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:17 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:18.531044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fc04bb52-c914-49a6-9dde-0870e4bb68fc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:18.531711 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fc04bb52-c914-49a6-9dde-0870e4bb68fc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:18.553371 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fc04bb52-c914-49a6-9dde-0870e4bb68fc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:18.553869 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fc04bb52-c914-49a6-9dde-0870e4bb68fc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:18.554784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fc04bb52-c914-49a6-9dde-0870e4bb68fc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:18.555255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fc04bb52-c914-49a6-9dde-0870e4bb68fc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:19.149147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dd1210e0-e0e2-4c30-97ad-987490a8a85a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:19.162780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dd1210e0-e0e2-4c30-97ad-987490a8a85a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:19.165151 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dd1210e0-e0e2-4c30-97ad-987490a8a85a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:19.166849 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dd1210e0-e0e2-4c30-97ad-987490a8a85a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 1.041648 Apr 16 16:52:19.168004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 225/410] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:18 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:52:19.174475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f5a7052b-01ed-4bce-bcfb-a22515a6e30b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:19.175213 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f5a7052b-01ed-4bce-bcfb-a22515a6e30b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:19.183316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f5a7052b-01ed-4bce-bcfb-a22515a6e30b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:19.184218 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f5a7052b-01ed-4bce-bcfb-a22515a6e30b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:19.185446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f5a7052b-01ed-4bce-bcfb-a22515a6e30b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:19.186761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f5a7052b-01ed-4bce-bcfb-a22515a6e30b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:19.386199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fc04bb52-c914-49a6-9dde-0870e4bb68fc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:19.405524 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fc04bb52-c914-49a6-9dde-0870e4bb68fc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.878748 Apr 16 16:52:19.406538 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 186/411] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:18 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:19.415735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-270fb667-33ed-49ed-b529-fae098a66420 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:19.421437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-270fb667-33ed-49ed-b529-fae098a66420 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:19.440853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-270fb667-33ed-49ed-b529-fae098a66420 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:19.443019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-270fb667-33ed-49ed-b529-fae098a66420 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:19.444135 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-270fb667-33ed-49ed-b529-fae098a66420 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:19.446962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-270fb667-33ed-49ed-b529-fae098a66420 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:19.729282 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f5a7052b-01ed-4bce-bcfb-a22515a6e30b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:19.764408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f5a7052b-01ed-4bce-bcfb-a22515a6e30b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.594607 Apr 16 16:52:19.789165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 226/412] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:19 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:19.810009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-580f7f55-da3a-43b2-a7bc-d2a59f7e6cf6 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:19.811091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-580f7f55-da3a-43b2-a7bc-d2a59f7e6cf6 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:19.820978 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-580f7f55-da3a-43b2-a7bc-d2a59f7e6cf6 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:19.821645 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-580f7f55-da3a-43b2-a7bc-d2a59f7e6cf6 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:19.822736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-580f7f55-da3a-43b2-a7bc-d2a59f7e6cf6 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:19.823358 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-580f7f55-da3a-43b2-a7bc-d2a59f7e6cf6 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:19.982174 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-270fb667-33ed-49ed-b529-fae098a66420 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:19.992300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-270fb667-33ed-49ed-b529-fae098a66420 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.584378 Apr 16 16:52:20.002656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 187/413] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:19 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:20.007847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-d63ebf72-d0c1-4327-9ab5-f1af4279ff3b req-7826a459-337b-47e8-a65a-653fdbdcd160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "352dbe2a-d325-41eb-808c-36a4534b171b", "name": "network-vif-plugged", "status": "completed", "tag": "51b8feb1-4963-4f27-81af-59dd11a082f7"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:20.009672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:52:20.009672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:52:20.019005 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-d63ebf72-d0c1-4327-9ab5-f1af4279ff3b req-7826a459-337b-47e8-a65a-653fdbdcd160 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:20.019505 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-d63ebf72-d0c1-4327-9ab5-f1af4279ff3b req-7826a459-337b-47e8-a65a-653fdbdcd160 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:20.052116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-d63ebf72-d0c1-4327-9ab5-f1af4279ff3b req-7826a459-337b-47e8-a65a-653fdbdcd160 service nova] Creating event network-vif-plugged:51b8feb1-4963-4f27-81af-59dd11a082f7 for instance 352dbe2a-d325-41eb-808c-36a4534b171b on hv-cinder-73362 Apr 16 16:52:20.075822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-d63ebf72-d0c1-4327-9ab5-f1af4279ff3b req-7826a459-337b-47e8-a65a-653fdbdcd160 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071651 Apr 16 16:52:20.076486 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 188/414] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:52:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:20.119125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-580f7f55-da3a-43b2-a7bc-d2a59f7e6cf6 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:20.130694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-580f7f55-da3a-43b2-a7bc-d2a59f7e6cf6 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1318 microversion: 2.1 time: 0.339767 Apr 16 16:52:20.131413 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 227/415] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:19 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:20.194867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7219e9c2-61d4-4c11-8467-26be82452562 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:20.196400 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7219e9c2-61d4-4c11-8467-26be82452562 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:20.210040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7219e9c2-61d4-4c11-8467-26be82452562 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:20.210840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7219e9c2-61d4-4c11-8467-26be82452562 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:20.211851 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7219e9c2-61d4-4c11-8467-26be82452562 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:20.212494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7219e9c2-61d4-4c11-8467-26be82452562 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:20.426035 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4196b13a-de4b-461b-9e81-51563df488d8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:20.427058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4196b13a-de4b-461b-9e81-51563df488d8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:20.449179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4196b13a-de4b-461b-9e81-51563df488d8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:20.449927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4196b13a-de4b-461b-9e81-51563df488d8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:20.450184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7219e9c2-61d4-4c11-8467-26be82452562 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:20.450841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4196b13a-de4b-461b-9e81-51563df488d8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:20.451306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4196b13a-de4b-461b-9e81-51563df488d8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:20.462479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7219e9c2-61d4-4c11-8467-26be82452562 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:20.464240 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7219e9c2-61d4-4c11-8467-26be82452562 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:20.465496 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7219e9c2-61d4-4c11-8467-26be82452562 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.282368 Apr 16 16:52:20.466248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 189/416] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:20 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:20.772487 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4196b13a-de4b-461b-9e81-51563df488d8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:20.783021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4196b13a-de4b-461b-9e81-51563df488d8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.361974 Apr 16 16:52:20.784175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 228/417] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:20 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:20.805195 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2906c301-4f34-40c2-ba6a-c1ca4ea9e1dd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:20.806114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2906c301-4f34-40c2-ba6a-c1ca4ea9e1dd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:20.832054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2906c301-4f34-40c2-ba6a-c1ca4ea9e1dd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:20.832054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2906c301-4f34-40c2-ba6a-c1ca4ea9e1dd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:20.832054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2906c301-4f34-40c2-ba6a-c1ca4ea9e1dd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:20.832533 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2906c301-4f34-40c2-ba6a-c1ca4ea9e1dd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.009600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-302d30e0-eacd-41a5-9bfc-989d3db9cb6d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:21.010319 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-302d30e0-eacd-41a5-9bfc-989d3db9cb6d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:21.043214 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-302d30e0-eacd-41a5-9bfc-989d3db9cb6d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.044082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-302d30e0-eacd-41a5-9bfc-989d3db9cb6d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.045180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-302d30e0-eacd-41a5-9bfc-989d3db9cb6d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.045883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-302d30e0-eacd-41a5-9bfc-989d3db9cb6d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.247922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2906c301-4f34-40c2-ba6a-c1ca4ea9e1dd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:21.271507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2906c301-4f34-40c2-ba6a-c1ca4ea9e1dd tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.471005 Apr 16 16:52:21.272436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 190/418] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:20 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:21.281307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5a1c9bdf-2756-4d0a-a93b-c6e6b99691a9 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:21.282506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5a1c9bdf-2756-4d0a-a93b-c6e6b99691a9 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:21.294974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a1c9bdf-2756-4d0a-a93b-c6e6b99691a9 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.295639 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a1c9bdf-2756-4d0a-a93b-c6e6b99691a9 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.297231 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a1c9bdf-2756-4d0a-a93b-c6e6b99691a9 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.297879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a1c9bdf-2756-4d0a-a93b-c6e6b99691a9 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.350319 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-302d30e0-eacd-41a5-9bfc-989d3db9cb6d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:21.388460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-302d30e0-eacd-41a5-9bfc-989d3db9cb6d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1322 microversion: 2.1 time: 0.378797 Apr 16 16:52:21.388460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 229/419] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:21 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:21.486175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-65d4f6a6-a882-44e3-9d2f-ae6f168895d2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:21.487347 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-65d4f6a6-a882-44e3-9d2f-ae6f168895d2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:21.496143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-65d4f6a6-a882-44e3-9d2f-ae6f168895d2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.496917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-65d4f6a6-a882-44e3-9d2f-ae6f168895d2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.498000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-65d4f6a6-a882-44e3-9d2f-ae6f168895d2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.498820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-65d4f6a6-a882-44e3-9d2f-ae6f168895d2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.567412 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5a1c9bdf-2756-4d0a-a93b-c6e6b99691a9 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:21.576557 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5a1c9bdf-2756-4d0a-a93b-c6e6b99691a9 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1468 microversion: 2.1 time: 0.302756 Apr 16 16:52:21.578713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 191/420] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:21 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1468 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:21.665313 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a7721517-a742-4f4f-a80e-73c168dd7c4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:21.665968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a7721517-a742-4f4f-a80e-73c168dd7c4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:21.674351 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7721517-a742-4f4f-a80e-73c168dd7c4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.674991 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7721517-a742-4f4f-a80e-73c168dd7c4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.675945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7721517-a742-4f4f-a80e-73c168dd7c4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.676517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7721517-a742-4f4f-a80e-73c168dd7c4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.747024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a7721517-a742-4f4f-a80e-73c168dd7c4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Going to try to terminate instance {{(pid=99399) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:52:21.753357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-65d4f6a6-a882-44e3-9d2f-ae6f168895d2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:21.767513 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-65d4f6a6-a882-44e3-9d2f-ae6f168895d2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:21.771536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-65d4f6a6-a882-44e3-9d2f-ae6f168895d2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:21.773212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-65d4f6a6-a882-44e3-9d2f-ae6f168895d2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.292025 Apr 16 16:52:21.785570 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 230/421] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:21 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:21.802450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-44a1b866-ba78-459c-9a8b-0d730e6ffbae tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:21.803526 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-44a1b866-ba78-459c-9a8b-0d730e6ffbae tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:21.820967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-44a1b866-ba78-459c-9a8b-0d730e6ffbae tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.821473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-44a1b866-ba78-459c-9a8b-0d730e6ffbae tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.822366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-44a1b866-ba78-459c-9a8b-0d730e6ffbae tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.822858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-44a1b866-ba78-459c-9a8b-0d730e6ffbae tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.911817 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a7721517-a742-4f4f-a80e-73c168dd7c4d tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "DELETE /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 204 len: 0 microversion: 2.1 time: 0.250899 Apr 16 16:52:21.912456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 192/422] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:52:21 2021] DELETE /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:52:21.929980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f6d1be1f-b36f-4d40-9fb6-75cc6633a881 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:21.931100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f6d1be1f-b36f-4d40-9fb6-75cc6633a881 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:21.943490 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6d1be1f-b36f-4d40-9fb6-75cc6633a881 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.944220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6d1be1f-b36f-4d40-9fb6-75cc6633a881 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:21.945151 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6d1be1f-b36f-4d40-9fb6-75cc6633a881 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:21.945642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6d1be1f-b36f-4d40-9fb6-75cc6633a881 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:22.206334 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-44a1b866-ba78-459c-9a8b-0d730e6ffbae tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:22.220399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-44a1b866-ba78-459c-9a8b-0d730e6ffbae tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.422007 Apr 16 16:52:22.231148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 231/423] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:21 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:22.292563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-39e07b25-16a4-4917-85ad-da693204a961 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:22.293385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-39e07b25-16a4-4917-85ad-da693204a961 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:22.304149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-39e07b25-16a4-4917-85ad-da693204a961 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:22.304799 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-39e07b25-16a4-4917-85ad-da693204a961 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:22.305899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-39e07b25-16a4-4917-85ad-da693204a961 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:22.309805 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f6d1be1f-b36f-4d40-9fb6-75cc6633a881 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:22.316315 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-39e07b25-16a4-4917-85ad-da693204a961 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:22.331019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f6d1be1f-b36f-4d40-9fb6-75cc6633a881 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1474 microversion: 2.1 time: 0.408904 Apr 16 16:52:22.332053 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 193/424] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:21 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1474 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:22.415082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2c9ba843-fbab-48bf-bbd6-9c3259545385 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:22.415782 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2c9ba843-fbab-48bf-bbd6-9c3259545385 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:22.450833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2c9ba843-fbab-48bf-bbd6-9c3259545385 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:22.453400 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2c9ba843-fbab-48bf-bbd6-9c3259545385 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:22.463331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2c9ba843-fbab-48bf-bbd6-9c3259545385 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:22.463936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2c9ba843-fbab-48bf-bbd6-9c3259545385 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:22.962848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2c9ba843-fbab-48bf-bbd6-9c3259545385 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:22.975111 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2c9ba843-fbab-48bf-bbd6-9c3259545385 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1511 microversion: 2.1 time: 0.563128 Apr 16 16:52:22.976009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 194/425] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:22 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1511 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:22.977254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-39e07b25-16a4-4917-85ad-da693204a961 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:22.981385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4d160c2f-4126-4fb1-9606-9fb2458a1e58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:22.982270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4d160c2f-4126-4fb1-9606-9fb2458a1e58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:22.987614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-39e07b25-16a4-4917-85ad-da693204a961 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.699283 Apr 16 16:52:22.991957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d160c2f-4126-4fb1-9606-9fb2458a1e58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:22.992738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d160c2f-4126-4fb1-9606-9fb2458a1e58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:22.994054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d160c2f-4126-4fb1-9606-9fb2458a1e58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:22.994714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d160c2f-4126-4fb1-9606-9fb2458a1e58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:23.015250 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 232/426] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:22 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:23.242593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0e54c7fb-2c81-4fb7-9606-c8b650edeac4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:23.244117 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0e54c7fb-2c81-4fb7-9606-c8b650edeac4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:23.260805 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4d160c2f-4126-4fb1-9606-9fb2458a1e58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:23.262138 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e54c7fb-2c81-4fb7-9606-c8b650edeac4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:23.263225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e54c7fb-2c81-4fb7-9606-c8b650edeac4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:23.266681 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e54c7fb-2c81-4fb7-9606-c8b650edeac4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:23.267445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e54c7fb-2c81-4fb7-9606-c8b650edeac4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:23.274647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4d160c2f-4126-4fb1-9606-9fb2458a1e58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:23.276677 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4d160c2f-4126-4fb1-9606-9fb2458a1e58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:23.277921 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4d160c2f-4126-4fb1-9606-9fb2458a1e58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.300679 Apr 16 16:52:23.278574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 195/427] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:22 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:23.357172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fa0451ba-0529-490e-a69f-56b1fb43c3ac tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:23.357990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fa0451ba-0529-490e-a69f-56b1fb43c3ac tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:23.368862 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa0451ba-0529-490e-a69f-56b1fb43c3ac tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:23.369537 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa0451ba-0529-490e-a69f-56b1fb43c3ac tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:23.370775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa0451ba-0529-490e-a69f-56b1fb43c3ac tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:23.371473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa0451ba-0529-490e-a69f-56b1fb43c3ac tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:23.604349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0e54c7fb-2c81-4fb7-9606-c8b650edeac4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:23.620248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0e54c7fb-2c81-4fb7-9606-c8b650edeac4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.384031 Apr 16 16:52:23.625345 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 233/428] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:23 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:23.717428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fa0451ba-0529-490e-a69f-56b1fb43c3ac tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:23.727307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fa0451ba-0529-490e-a69f-56b1fb43c3ac tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1474 microversion: 2.1 time: 0.375124 Apr 16 16:52:23.728040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 196/429] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:23 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:24.026949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b4a8722d-845f-4e6f-ad41-a099a038cfd6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:24.029141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b4a8722d-845f-4e6f-ad41-a099a038cfd6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:24.041391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4a8722d-845f-4e6f-ad41-a099a038cfd6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:24.042006 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4a8722d-845f-4e6f-ad41-a099a038cfd6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:24.043080 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4a8722d-845f-4e6f-ad41-a099a038cfd6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:24.044130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4a8722d-845f-4e6f-ad41-a099a038cfd6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:24.297670 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a45451a8-a1d4-4709-a69e-bbdfc14f95c4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:24.298390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a45451a8-a1d4-4709-a69e-bbdfc14f95c4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:24.310657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a45451a8-a1d4-4709-a69e-bbdfc14f95c4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:24.311168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a45451a8-a1d4-4709-a69e-bbdfc14f95c4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:24.312200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a45451a8-a1d4-4709-a69e-bbdfc14f95c4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:24.312727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a45451a8-a1d4-4709-a69e-bbdfc14f95c4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:24.330743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b4a8722d-845f-4e6f-ad41-a099a038cfd6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:24.365884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b4a8722d-845f-4e6f-ad41-a099a038cfd6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.345390 Apr 16 16:52:24.371198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 234/430] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:24 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:24.587755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a45451a8-a1d4-4709-a69e-bbdfc14f95c4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:24.598577 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a45451a8-a1d4-4709-a69e-bbdfc14f95c4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:24.600444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a45451a8-a1d4-4709-a69e-bbdfc14f95c4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:24.601749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a45451a8-a1d4-4709-a69e-bbdfc14f95c4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.308512 Apr 16 16:52:24.604643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 197/431] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:24 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:24.646903 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2b0a3ed0-cb6f-46d3-a442-71880ec62ec0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:24.648757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2b0a3ed0-cb6f-46d3-a442-71880ec62ec0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:24.660629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b0a3ed0-cb6f-46d3-a442-71880ec62ec0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:24.661590 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b0a3ed0-cb6f-46d3-a442-71880ec62ec0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:24.663402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b0a3ed0-cb6f-46d3-a442-71880ec62ec0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:24.664025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b0a3ed0-cb6f-46d3-a442-71880ec62ec0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:24.745209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-738477f8-883c-4069-bc03-b7d4afcbccb3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:24.746189 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-738477f8-883c-4069-bc03-b7d4afcbccb3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:24.757928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-738477f8-883c-4069-bc03-b7d4afcbccb3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:24.760205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-738477f8-883c-4069-bc03-b7d4afcbccb3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:24.761163 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-738477f8-883c-4069-bc03-b7d4afcbccb3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:24.762926 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-738477f8-883c-4069-bc03-b7d4afcbccb3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:25.100953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-738477f8-883c-4069-bc03-b7d4afcbccb3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:25.112526 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2b0a3ed0-cb6f-46d3-a442-71880ec62ec0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:25.113182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-738477f8-883c-4069-bc03-b7d4afcbccb3 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1474 microversion: 2.1 time: 0.371707 Apr 16 16:52:25.113832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 198/432] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:24 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1474 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:25.125078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-effa62a8-d0e8-4a30-a4f7-0aea4d789c8a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f35cac76-ffaa-479b-be57-9dce0ef983d0"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:25.127391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-effa62a8-d0e8-4a30-a4f7-0aea4d789c8a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:25.133559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2b0a3ed0-cb6f-46d3-a442-71880ec62ec0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.493535 Apr 16 16:52:25.141687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-effa62a8-d0e8-4a30-a4f7-0aea4d789c8a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:25.143093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-effa62a8-d0e8-4a30-a4f7-0aea4d789c8a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:25.143841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-effa62a8-d0e8-4a30-a4f7-0aea4d789c8a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:25.144358 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-effa62a8-d0e8-4a30-a4f7-0aea4d789c8a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:25.144788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 235/433] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:24 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:25.392151 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2a3b3f6f-272a-484c-9cee-581af1e49807 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:25.393508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2a3b3f6f-272a-484c-9cee-581af1e49807 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:25.403570 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a3b3f6f-272a-484c-9cee-581af1e49807 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:25.404340 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a3b3f6f-272a-484c-9cee-581af1e49807 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:25.405804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a3b3f6f-272a-484c-9cee-581af1e49807 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:25.407235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a3b3f6f-272a-484c-9cee-581af1e49807 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:25.774456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2a3b3f6f-272a-484c-9cee-581af1e49807 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:25.774456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2a3b3f6f-272a-484c-9cee-581af1e49807 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1507 microversion: 2.1 time: 0.356696 Apr 16 16:52:25.774456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 236/434] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:25 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:25.774456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2a2e4a9d-f496-4e80-93ad-8425ac067f90 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:25.774900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2a2e4a9d-f496-4e80-93ad-8425ac067f90 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:25.774900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a2e4a9d-f496-4e80-93ad-8425ac067f90 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:25.774900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a2e4a9d-f496-4e80-93ad-8425ac067f90 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:25.774900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a2e4a9d-f496-4e80-93ad-8425ac067f90 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:25.775163 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a2e4a9d-f496-4e80-93ad-8425ac067f90 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:25.824560 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-effa62a8-d0e8-4a30-a4f7-0aea4d789c8a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "POST /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.708483 Apr 16 16:52:25.837148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 199/435] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:52:25 2021] POST /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:25.878862 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e2ab2310-d905-4ec2-9f4c-147640a272da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4979d783-ed67-42b0-833d-79aba2d6a13d"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:25.881004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e2ab2310-d905-4ec2-9f4c-147640a272da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:25.915207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2ab2310-d905-4ec2-9f4c-147640a272da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:25.915207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2ab2310-d905-4ec2-9f4c-147640a272da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:25.915207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2ab2310-d905-4ec2-9f4c-147640a272da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:25.915207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2ab2310-d905-4ec2-9f4c-147640a272da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:26.073502 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-e2ab2310-d905-4ec2-9f4c-147640a272da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] HTTP exception thrown: Cannot 'attach_volume' instance 139562a9-bb46-4937-898d-cf6179ddc48d while it is in vm_state rescued Apr 16 16:52:26.074237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e2ab2310-d905-4ec2-9f4c-147640a272da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Returning 409 to user: Cannot 'attach_volume' instance 139562a9-bb46-4937-898d-cf6179ddc48d while it is in vm_state rescued {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:52:26.085862 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e2ab2310-d905-4ec2-9f4c-147640a272da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.218879 Apr 16 16:52:26.087006 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 200/436] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:52:25 2021] POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/os-volume_attachments => generated 152 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 16:52:26.105725 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-42c416da-ee6c-46b0-8538-5d818e548ee7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:26.106599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-42c416da-ee6c-46b0-8538-5d818e548ee7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:26.121744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-42c416da-ee6c-46b0-8538-5d818e548ee7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:26.123609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-42c416da-ee6c-46b0-8538-5d818e548ee7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:26.129042 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-42c416da-ee6c-46b0-8538-5d818e548ee7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:26.129722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-42c416da-ee6c-46b0-8538-5d818e548ee7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:26.284528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2a2e4a9d-f496-4e80-93ad-8425ac067f90 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:26.305936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2a2e4a9d-f496-4e80-93ad-8425ac067f90 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:26.308142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2a2e4a9d-f496-4e80-93ad-8425ac067f90 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:26.309669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2a2e4a9d-f496-4e80-93ad-8425ac067f90 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.562280 Apr 16 16:52:26.318396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 237/437] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:25 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:26.334547 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-374446d0-9191-41b7-8224-b1eac29216cc tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:26.335398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-374446d0-9191-41b7-8224-b1eac29216cc tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:26.355451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-374446d0-9191-41b7-8224-b1eac29216cc tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:26.356092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-374446d0-9191-41b7-8224-b1eac29216cc tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:26.357125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-374446d0-9191-41b7-8224-b1eac29216cc tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:26.357698 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-374446d0-9191-41b7-8224-b1eac29216cc tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:26.442889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-42c416da-ee6c-46b0-8538-5d818e548ee7 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/action" status: 202 len: 0 microversion: 2.1 time: 0.346390 Apr 16 16:52:26.444355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 201/438] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:52:26 2021] POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:52:26.450316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-82e7fcf8-6878-4d9d-b959-65ec793fb7d7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:26.451106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-82e7fcf8-6878-4d9d-b959-65ec793fb7d7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:26.462321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-82e7fcf8-6878-4d9d-b959-65ec793fb7d7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:26.462882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-82e7fcf8-6878-4d9d-b959-65ec793fb7d7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:26.463755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-82e7fcf8-6878-4d9d-b959-65ec793fb7d7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:26.464852 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-82e7fcf8-6878-4d9d-b959-65ec793fb7d7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:26.923842 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-374446d0-9191-41b7-8224-b1eac29216cc tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:26.951962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-374446d0-9191-41b7-8224-b1eac29216cc tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1474 microversion: 2.1 time: 0.632191 Apr 16 16:52:26.968863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 238/439] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:26 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1474 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:26.968863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-54882c4e-4dcf-408c-b481-917650309cff tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:26.968863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-54882c4e-4dcf-408c-b481-917650309cff tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:26.993620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-54882c4e-4dcf-408c-b481-917650309cff tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:26.994164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-54882c4e-4dcf-408c-b481-917650309cff tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:26.995301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-54882c4e-4dcf-408c-b481-917650309cff tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:26.995902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-54882c4e-4dcf-408c-b481-917650309cff tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:27.263257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-82e7fcf8-6878-4d9d-b959-65ec793fb7d7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:27.278957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-82e7fcf8-6878-4d9d-b959-65ec793fb7d7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.833239 Apr 16 16:52:27.284423 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 202/440] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:26 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:27.331506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b297d8cb-d697-4239-9824-4047e1b2bcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:27.332183 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b297d8cb-d697-4239-9824-4047e1b2bcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:27.351563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b297d8cb-d697-4239-9824-4047e1b2bcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:27.352445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b297d8cb-d697-4239-9824-4047e1b2bcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:27.354179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b297d8cb-d697-4239-9824-4047e1b2bcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:27.354735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b297d8cb-d697-4239-9824-4047e1b2bcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:27.648712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-54882c4e-4dcf-408c-b481-917650309cff tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:27.668699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-54882c4e-4dcf-408c-b481-917650309cff tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1515 microversion: 2.1 time: 0.714833 Apr 16 16:52:27.669855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 239/441] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:26 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1515 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:27.675517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-011e540e-acf2-4e0c-b88b-75b5177a511c req-b4af0780-1d3d-4420-9f02-fd38d6e6e94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500baa3d-78d8-4008-afc2-d49d5aaa1020", "name": "network-vif-deleted", "tag": "2d48f720-4baa-45ca-8271-4398ebd12575"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:27.677390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:52:27.677390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:52:27.690192 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-011e540e-acf2-4e0c-b88b-75b5177a511c req-b4af0780-1d3d-4420-9f02-fd38d6e6e94e service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:27.690674 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-011e540e-acf2-4e0c-b88b-75b5177a511c req-b4af0780-1d3d-4420-9f02-fd38d6e6e94e service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:27.716988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-011e540e-acf2-4e0c-b88b-75b5177a511c req-b4af0780-1d3d-4420-9f02-fd38d6e6e94e service nova] Creating event network-vif-deleted:2d48f720-4baa-45ca-8271-4398ebd12575 for instance 500baa3d-78d8-4008-afc2-d49d5aaa1020 on hv-cinder-73362 Apr 16 16:52:27.723531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-011e540e-acf2-4e0c-b88b-75b5177a511c req-b4af0780-1d3d-4420-9f02-fd38d6e6e94e service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052139 Apr 16 16:52:27.724473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 240/442] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:52:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:27.977989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:27.979451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:27.990694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:27.991644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:27.993057 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:27.993988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:28.129983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:28.130549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:28.132034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lazy-loading 'fault' on Instance uuid 500baa3d-78d8-4008-afc2-d49d5aaa1020 {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:52:28.276021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e35865ec7c54faeaf91e5a0b64af68b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46bd4eea651140208d2f5828845e4557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:28.290896 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b297d8cb-d697-4239-9824-4047e1b2bcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:28.298029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d8a9cb54-beea-449a-bfb7-4f370fd02429 tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 200 len: 1308 microversion: 2.1 time: 0.326405 Apr 16 16:52:28.313854 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 241/443] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:27 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 1308 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:28.317656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b297d8cb-d697-4239-9824-4047e1b2bcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:28.336094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0e275c5b-1d5c-40a5-ba8b-1f5df2da94cf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:28.336690 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0e275c5b-1d5c-40a5-ba8b-1f5df2da94cf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:28.341648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b297d8cb-d697-4239-9824-4047e1b2bcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:28.344072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b297d8cb-d697-4239-9824-4047e1b2bcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1749 microversion: 2.20 time: 1.017002 Apr 16 16:52:28.345226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 203/444] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:27 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1749 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:52:28.349260 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e275c5b-1d5c-40a5-ba8b-1f5df2da94cf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:28.349781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e275c5b-1d5c-40a5-ba8b-1f5df2da94cf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:28.350745 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e275c5b-1d5c-40a5-ba8b-1f5df2da94cf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:28.351286 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e275c5b-1d5c-40a5-ba8b-1f5df2da94cf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:28.694217 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fba18c9a-38c7-42fe-ac4c-3872bfde439c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:28.694902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fba18c9a-38c7-42fe-ac4c-3872bfde439c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:28.710900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fba18c9a-38c7-42fe-ac4c-3872bfde439c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:28.711673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fba18c9a-38c7-42fe-ac4c-3872bfde439c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:28.712739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fba18c9a-38c7-42fe-ac4c-3872bfde439c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:28.713397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fba18c9a-38c7-42fe-ac4c-3872bfde439c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:29.390501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0e275c5b-1d5c-40a5-ba8b-1f5df2da94cf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:29.415099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fba18c9a-38c7-42fe-ac4c-3872bfde439c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:29.428042 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0e275c5b-1d5c-40a5-ba8b-1f5df2da94cf tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 1.112406 Apr 16 16:52:29.430909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fba18c9a-38c7-42fe-ac4c-3872bfde439c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1515 microversion: 2.1 time: 0.742273 Apr 16 16:52:29.431675 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 204/445] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:28 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1515 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:29.436555 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ed164b7f-6441-4327-950f-1083a1cdb48e tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:29.437625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 242/446] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:28 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:29.442860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e8309553-711a-4da1-bd06-6d1525077f77 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:29.444889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ed164b7f-6441-4327-950f-1083a1cdb48e tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] [instance: 500baa3d-78d8-4008-afc2-d49d5aaa1020] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:29.450322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e8309553-711a-4da1-bd06-6d1525077f77 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:29.457871 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed164b7f-6441-4327-950f-1083a1cdb48e tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:29.464031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e8309553-711a-4da1-bd06-6d1525077f77 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:29.464762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed164b7f-6441-4327-950f-1083a1cdb48e tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:29.466017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed164b7f-6441-4327-950f-1083a1cdb48e tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:29.466653 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e8309553-711a-4da1-bd06-6d1525077f77 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:29.467027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed164b7f-6441-4327-950f-1083a1cdb48e tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:29.475908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e8309553-711a-4da1-bd06-6d1525077f77 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:29.476585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e8309553-711a-4da1-bd06-6d1525077f77 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:29.570651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-ed164b7f-6441-4327-950f-1083a1cdb48e tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] HTTP exception thrown: Instance 500baa3d-78d8-4008-afc2-d49d5aaa1020 could not be found. Apr 16 16:52:29.571415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ed164b7f-6441-4327-950f-1083a1cdb48e tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] Returning 404 to user: Instance 500baa3d-78d8-4008-afc2-d49d5aaa1020 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:52:29.572430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ed164b7f-6441-4327-950f-1083a1cdb48e tempest-VolumesNegativeTest-1198606342 tempest-VolumesNegativeTest-1198606342-project] 10.222.0.103 "GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020" status: 404 len: 111 microversion: 2.1 time: 0.139663 Apr 16 16:52:29.573156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 205/447] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:29 2021] GET /compute/v2.1/servers/500baa3d-78d8-4008-afc2-d49d5aaa1020 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:52:29.919075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e8309553-711a-4da1-bd06-6d1525077f77 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:29.939102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e8309553-711a-4da1-bd06-6d1525077f77 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:29.944570 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e8309553-711a-4da1-bd06-6d1525077f77 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:29.946078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e8309553-711a-4da1-bd06-6d1525077f77 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1749 microversion: 2.20 time: 0.507540 Apr 16 16:52:29.950932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 243/448] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:29 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1749 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:30.454249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6f72796d-4200-4a55-8a29-ac28f2692925 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:30.454990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6f72796d-4200-4a55-8a29-ac28f2692925 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:30.458216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fd0032b1-0ec0-4a4b-a459-7d414c5ddbdd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:30.459470 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fd0032b1-0ec0-4a4b-a459-7d414c5ddbdd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:30.469407 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd0032b1-0ec0-4a4b-a459-7d414c5ddbdd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:30.470167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd0032b1-0ec0-4a4b-a459-7d414c5ddbdd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:30.471928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd0032b1-0ec0-4a4b-a459-7d414c5ddbdd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:30.473029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd0032b1-0ec0-4a4b-a459-7d414c5ddbdd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:30.476036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6f72796d-4200-4a55-8a29-ac28f2692925 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:30.477054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6f72796d-4200-4a55-8a29-ac28f2692925 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:30.478150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6f72796d-4200-4a55-8a29-ac28f2692925 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:30.481308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6f72796d-4200-4a55-8a29-ac28f2692925 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:30.881137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fd0032b1-0ec0-4a4b-a459-7d414c5ddbdd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:30.902256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fd0032b1-0ec0-4a4b-a459-7d414c5ddbdd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.445080 Apr 16 16:52:30.903004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 244/449] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:30 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:30.966642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6f72796d-4200-4a55-8a29-ac28f2692925 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:30.973379 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8e8b3da0-9480-442b-a384-aca046409cbe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:30.974055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8e8b3da0-9480-442b-a384-aca046409cbe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:30.983464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e8b3da0-9480-442b-a384-aca046409cbe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:30.984477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e8b3da0-9480-442b-a384-aca046409cbe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:30.985650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6f72796d-4200-4a55-8a29-ac28f2692925 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1515 microversion: 2.1 time: 0.536096 Apr 16 16:52:30.986972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 206/450] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:30 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1515 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:30.997991 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e8b3da0-9480-442b-a384-aca046409cbe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:30.999793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e8b3da0-9480-442b-a384-aca046409cbe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:31.340000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8e8b3da0-9480-442b-a384-aca046409cbe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:31.353899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8e8b3da0-9480-442b-a384-aca046409cbe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:31.357803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8e8b3da0-9480-442b-a384-aca046409cbe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:31.359196 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8e8b3da0-9480-442b-a384-aca046409cbe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1749 microversion: 2.20 time: 0.391748 Apr 16 16:52:31.360693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 245/451] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:30 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1749 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:52:31.507491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-057d48cb-9f60-4454-9095-c31c554ef12a req-58de9b48-ad53-4d95-a3f0-6b9924487d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf021fce-d230-4117-992c-f91cd978276c", "name": "network-vif-plugged", "status": "completed", "tag": "fd825542-a1af-4ba6-8c00-d64d5199c7e6"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:31.509774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:52:31.509774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:52:31.523469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-057d48cb-9f60-4454-9095-c31c554ef12a req-58de9b48-ad53-4d95-a3f0-6b9924487d82 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:31.524194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-057d48cb-9f60-4454-9095-c31c554ef12a req-58de9b48-ad53-4d95-a3f0-6b9924487d82 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:31.558722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-057d48cb-9f60-4454-9095-c31c554ef12a req-58de9b48-ad53-4d95-a3f0-6b9924487d82 service nova] Creating event network-vif-plugged:fd825542-a1af-4ba6-8c00-d64d5199c7e6 for instance bf021fce-d230-4117-992c-f91cd978276c on hv-cinder-73362 Apr 16 16:52:31.577270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-057d48cb-9f60-4454-9095-c31c554ef12a req-58de9b48-ad53-4d95-a3f0-6b9924487d82 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076023 Apr 16 16:52:31.580983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 207/452] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:52:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:31.922890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ae87b3f6-5d86-4da6-8a92-078ba46e0444 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:31.924227 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ae87b3f6-5d86-4da6-8a92-078ba46e0444 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:31.934747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae87b3f6-5d86-4da6-8a92-078ba46e0444 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:31.935765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae87b3f6-5d86-4da6-8a92-078ba46e0444 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:31.936802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae87b3f6-5d86-4da6-8a92-078ba46e0444 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:31.937748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae87b3f6-5d86-4da6-8a92-078ba46e0444 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:32.006096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3b41a4a7-64bf-42b8-a8d3-fffc9398344b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:32.007620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3b41a4a7-64bf-42b8-a8d3-fffc9398344b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:32.020561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3b41a4a7-64bf-42b8-a8d3-fffc9398344b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:32.026763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3b41a4a7-64bf-42b8-a8d3-fffc9398344b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:32.028031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3b41a4a7-64bf-42b8-a8d3-fffc9398344b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:32.029652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3b41a4a7-64bf-42b8-a8d3-fffc9398344b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:32.467148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ae87b3f6-5d86-4da6-8a92-078ba46e0444 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:32.485004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ae87b3f6-5d86-4da6-8a92-078ba46e0444 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.566188 Apr 16 16:52:32.486099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 246/453] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:31 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:32.506723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d9ed13dd-f14d-4ac4-a9f4-0f73fe1ece44 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:32.513661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d9ed13dd-f14d-4ac4-a9f4-0f73fe1ece44 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:32.542707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d9ed13dd-f14d-4ac4-a9f4-0f73fe1ece44 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:32.543702 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d9ed13dd-f14d-4ac4-a9f4-0f73fe1ece44 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:32.545044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d9ed13dd-f14d-4ac4-a9f4-0f73fe1ece44 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:32.545872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d9ed13dd-f14d-4ac4-a9f4-0f73fe1ece44 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:32.605437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3b41a4a7-64bf-42b8-a8d3-fffc9398344b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:32.620226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3b41a4a7-64bf-42b8-a8d3-fffc9398344b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1515 microversion: 2.1 time: 0.618937 Apr 16 16:52:32.626054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 208/454] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:31 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1515 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:32.911513 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d9ed13dd-f14d-4ac4-a9f4-0f73fe1ece44 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:32.925648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d9ed13dd-f14d-4ac4-a9f4-0f73fe1ece44 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:32.928485 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d9ed13dd-f14d-4ac4-a9f4-0f73fe1ece44 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:32.930392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d9ed13dd-f14d-4ac4-a9f4-0f73fe1ece44 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 0.433966 Apr 16 16:52:32.931206 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 247/455] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:32 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:33.512078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9541bdea-3951-492c-b9be-3ff4447ed81b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:33.513804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9541bdea-3951-492c-b9be-3ff4447ed81b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:33.526245 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9541bdea-3951-492c-b9be-3ff4447ed81b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:33.527064 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9541bdea-3951-492c-b9be-3ff4447ed81b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:33.530022 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9541bdea-3951-492c-b9be-3ff4447ed81b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:33.532506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9541bdea-3951-492c-b9be-3ff4447ed81b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:33.649256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-eb9e3a99-2732-4088-a96d-f0cd695b0876 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:33.650106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-eb9e3a99-2732-4088-a96d-f0cd695b0876 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:33.666942 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eb9e3a99-2732-4088-a96d-f0cd695b0876 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:33.667788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eb9e3a99-2732-4088-a96d-f0cd695b0876 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:33.669880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eb9e3a99-2732-4088-a96d-f0cd695b0876 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:33.672038 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eb9e3a99-2732-4088-a96d-f0cd695b0876 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:33.963843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9541bdea-3951-492c-b9be-3ff4447ed81b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:33.977418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9541bdea-3951-492c-b9be-3ff4447ed81b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.472904 Apr 16 16:52:33.997136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 209/456] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:33 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:34.026826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-86bba9b3-4402-4a6e-a1e5-d0c9285bcfd9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:34.027721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-86bba9b3-4402-4a6e-a1e5-d0c9285bcfd9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:34.056271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-86bba9b3-4402-4a6e-a1e5-d0c9285bcfd9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:34.063756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-86bba9b3-4402-4a6e-a1e5-d0c9285bcfd9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:34.065910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-86bba9b3-4402-4a6e-a1e5-d0c9285bcfd9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:34.066654 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-86bba9b3-4402-4a6e-a1e5-d0c9285bcfd9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:34.152783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-eb9e3a99-2732-4088-a96d-f0cd695b0876 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:34.170066 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-eb9e3a99-2732-4088-a96d-f0cd695b0876 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1515 microversion: 2.1 time: 0.524847 Apr 16 16:52:34.171074 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 248/457] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:33 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1515 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:34.403355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-86bba9b3-4402-4a6e-a1e5-d0c9285bcfd9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:34.416342 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-86bba9b3-4402-4a6e-a1e5-d0c9285bcfd9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:34.418144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-86bba9b3-4402-4a6e-a1e5-d0c9285bcfd9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:34.419835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-86bba9b3-4402-4a6e-a1e5-d0c9285bcfd9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 0.421263 Apr 16 16:52:34.434029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 210/458] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:33 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:34.996970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0d72e742-b360-4996-907f-3ae3a07c8b63 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:34.997653 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0d72e742-b360-4996-907f-3ae3a07c8b63 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:35.008551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d72e742-b360-4996-907f-3ae3a07c8b63 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:35.009059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d72e742-b360-4996-907f-3ae3a07c8b63 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:35.010142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d72e742-b360-4996-907f-3ae3a07c8b63 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:35.010477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d72e742-b360-4996-907f-3ae3a07c8b63 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:35.197893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a5cc1dcb-9367-474b-9fa1-992e6a825ca1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:35.198860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a5cc1dcb-9367-474b-9fa1-992e6a825ca1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:35.216731 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a5cc1dcb-9367-474b-9fa1-992e6a825ca1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:35.226432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a5cc1dcb-9367-474b-9fa1-992e6a825ca1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:35.228033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a5cc1dcb-9367-474b-9fa1-992e6a825ca1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:35.228582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a5cc1dcb-9367-474b-9fa1-992e6a825ca1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:35.315390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0d72e742-b360-4996-907f-3ae3a07c8b63 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:35.327854 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0d72e742-b360-4996-907f-3ae3a07c8b63 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.334761 Apr 16 16:52:35.329385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 249/459] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:34 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:35.441961 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-02a74339-1cae-411d-a274-638d61551947 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:35.442654 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-02a74339-1cae-411d-a274-638d61551947 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:35.462114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-02a74339-1cae-411d-a274-638d61551947 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:35.462658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-02a74339-1cae-411d-a274-638d61551947 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:35.463595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-02a74339-1cae-411d-a274-638d61551947 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:35.464130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-02a74339-1cae-411d-a274-638d61551947 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:35.556841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a5cc1dcb-9367-474b-9fa1-992e6a825ca1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:35.567864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a5cc1dcb-9367-474b-9fa1-992e6a825ca1 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1515 microversion: 2.1 time: 0.374622 Apr 16 16:52:35.568678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 211/460] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:35 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1515 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:35.782611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-02a74339-1cae-411d-a274-638d61551947 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:35.795723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-02a74339-1cae-411d-a274-638d61551947 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:35.797425 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-02a74339-1cae-411d-a274-638d61551947 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:35.799415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-02a74339-1cae-411d-a274-638d61551947 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 0.361549 Apr 16 16:52:35.800599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 250/461] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:35 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:36.350793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-61241b7e-b8e8-48f4-94be-bf0ef5871bcd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:36.352408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-61241b7e-b8e8-48f4-94be-bf0ef5871bcd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:36.362680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-61241b7e-b8e8-48f4-94be-bf0ef5871bcd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:36.363188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-61241b7e-b8e8-48f4-94be-bf0ef5871bcd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:36.364055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-61241b7e-b8e8-48f4-94be-bf0ef5871bcd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:36.364552 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-61241b7e-b8e8-48f4-94be-bf0ef5871bcd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:36.588146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-77db7456-c21c-4042-a902-ec7588c55326 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:36.589190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-77db7456-c21c-4042-a902-ec7588c55326 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:36.606051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77db7456-c21c-4042-a902-ec7588c55326 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:36.617897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77db7456-c21c-4042-a902-ec7588c55326 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:36.621857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77db7456-c21c-4042-a902-ec7588c55326 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:36.622648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77db7456-c21c-4042-a902-ec7588c55326 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:37.274928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-61241b7e-b8e8-48f4-94be-bf0ef5871bcd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:37.286661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-61241b7e-b8e8-48f4-94be-bf0ef5871bcd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.941592 Apr 16 16:52:37.287314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 212/462] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:36 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:37.304988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c0b6ad7f-0ff6-48d6-b9cc-a5518fb7daf5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:37.305699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c0b6ad7f-0ff6-48d6-b9cc-a5518fb7daf5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:37.339910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c0b6ad7f-0ff6-48d6-b9cc-a5518fb7daf5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:37.340380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c0b6ad7f-0ff6-48d6-b9cc-a5518fb7daf5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:37.341243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c0b6ad7f-0ff6-48d6-b9cc-a5518fb7daf5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:37.341724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c0b6ad7f-0ff6-48d6-b9cc-a5518fb7daf5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:37.513124 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-77db7456-c21c-4042-a902-ec7588c55326 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:37.528380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-77db7456-c21c-4042-a902-ec7588c55326 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1515 microversion: 2.1 time: 0.944711 Apr 16 16:52:37.534919 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 251/463] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:36 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1515 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:37.843190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c0b6ad7f-0ff6-48d6-b9cc-a5518fb7daf5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:37.863512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c0b6ad7f-0ff6-48d6-b9cc-a5518fb7daf5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:37.865520 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c0b6ad7f-0ff6-48d6-b9cc-a5518fb7daf5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:37.867326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c0b6ad7f-0ff6-48d6-b9cc-a5518fb7daf5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 0.578635 Apr 16 16:52:37.868656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 213/464] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:37 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:38.211009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-63b7f00c-e5e8-485d-86ac-cc72d5b2478a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:38.233243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63b7f00c-e5e8-485d-86ac-cc72d5b2478a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:38.233760 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63b7f00c-e5e8-485d-86ac-cc72d5b2478a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:38.306912 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-987248d5-464d-4837-acf1-7150a1915893 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:38.307607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-987248d5-464d-4837-acf1-7150a1915893 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:38.328769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-987248d5-464d-4837-acf1-7150a1915893 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:38.339118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-987248d5-464d-4837-acf1-7150a1915893 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:38.357848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-987248d5-464d-4837-acf1-7150a1915893 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:38.362275 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-987248d5-464d-4837-acf1-7150a1915893 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:38.389395 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-63b7f00c-e5e8-485d-86ac-cc72d5b2478a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Going to try to stop instance {{(pid=99398) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 16 16:52:38.636283 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-63b7f00c-e5e8-485d-86ac-cc72d5b2478a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 202 len: 0 microversion: 2.1 time: 0.429538 Apr 16 16:52:38.643181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 252/465] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:52:38 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:52:38.656134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-74218e33-988d-4dae-be7c-2ddeb8030a9b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:38.660105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-74218e33-988d-4dae-be7c-2ddeb8030a9b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:38.719635 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74218e33-988d-4dae-be7c-2ddeb8030a9b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:38.724356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74218e33-988d-4dae-be7c-2ddeb8030a9b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:38.733938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74218e33-988d-4dae-be7c-2ddeb8030a9b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:38.735969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74218e33-988d-4dae-be7c-2ddeb8030a9b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:39.018647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-987248d5-464d-4837-acf1-7150a1915893 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:39.049329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-987248d5-464d-4837-acf1-7150a1915893 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.747090 Apr 16 16:52:39.066723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 214/466] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:38 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:39.091274 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a6686c53-69f0-478a-bf7b-f689aa3a02a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:39.092440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a6686c53-69f0-478a-bf7b-f689aa3a02a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:39.118658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6686c53-69f0-478a-bf7b-f689aa3a02a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:39.119255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6686c53-69f0-478a-bf7b-f689aa3a02a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:39.120125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6686c53-69f0-478a-bf7b-f689aa3a02a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:39.120621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6686c53-69f0-478a-bf7b-f689aa3a02a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:39.580124 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-74218e33-988d-4dae-be7c-2ddeb8030a9b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:39.598655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-74218e33-988d-4dae-be7c-2ddeb8030a9b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1521 microversion: 2.1 time: 0.953488 Apr 16 16:52:39.603012 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 253/467] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:38 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1521 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:39.618590 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ff951481-bd26-419c-8d50-3546f4778612 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:39.619680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ff951481-bd26-419c-8d50-3546f4778612 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:39.637704 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff951481-bd26-419c-8d50-3546f4778612 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:39.638168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff951481-bd26-419c-8d50-3546f4778612 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:39.638981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff951481-bd26-419c-8d50-3546f4778612 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:39.639483 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff951481-bd26-419c-8d50-3546f4778612 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:39.837313 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a6686c53-69f0-478a-bf7b-f689aa3a02a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:39.856606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a6686c53-69f0-478a-bf7b-f689aa3a02a6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1728 microversion: 2.1 time: 0.784848 Apr 16 16:52:39.857667 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 215/468] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:39 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1728 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:40.088449 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f51e461b-e110-4356-a165-2f1e0a5b6bac tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:40.096735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f51e461b-e110-4356-a165-2f1e0a5b6bac tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:40.155003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f51e461b-e110-4356-a165-2f1e0a5b6bac tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:40.164116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f51e461b-e110-4356-a165-2f1e0a5b6bac tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:40.167756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f51e461b-e110-4356-a165-2f1e0a5b6bac tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:40.168832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f51e461b-e110-4356-a165-2f1e0a5b6bac tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:40.723355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ff951481-bd26-419c-8d50-3546f4778612 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:40.741872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ff951481-bd26-419c-8d50-3546f4778612 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:40.746639 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ff951481-bd26-419c-8d50-3546f4778612 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:40.750831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ff951481-bd26-419c-8d50-3546f4778612 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 1.142180 Apr 16 16:52:40.752330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 254/469] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:39 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:40.841169 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f51e461b-e110-4356-a165-2f1e0a5b6bac tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:40.853122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f51e461b-e110-4356-a165-2f1e0a5b6bac tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.772917 Apr 16 16:52:40.854013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 216/470] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:40 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:40.888460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b136d1be-756e-422a-954e-5d8c6bbc0026 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:40.889141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b136d1be-756e-422a-954e-5d8c6bbc0026 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:40.903980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b136d1be-756e-422a-954e-5d8c6bbc0026 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:40.904501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b136d1be-756e-422a-954e-5d8c6bbc0026 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:40.905370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b136d1be-756e-422a-954e-5d8c6bbc0026 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:40.905990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b136d1be-756e-422a-954e-5d8c6bbc0026 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:41.502853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b136d1be-756e-422a-954e-5d8c6bbc0026 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:41.529224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b136d1be-756e-422a-954e-5d8c6bbc0026 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1728 microversion: 2.1 time: 0.641033 Apr 16 16:52:41.532037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 255/471] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:40 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1728 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:41.776220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-462a77c9-605b-457b-b42e-bc97df63f365 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:41.776865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-462a77c9-605b-457b-b42e-bc97df63f365 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:41.795009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-462a77c9-605b-457b-b42e-bc97df63f365 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:41.810455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-462a77c9-605b-457b-b42e-bc97df63f365 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:41.811399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-462a77c9-605b-457b-b42e-bc97df63f365 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:41.811910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-462a77c9-605b-457b-b42e-bc97df63f365 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:41.873794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-567629dc-9a1f-4a3c-ac85-b2237aaa554c tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:41.874506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-567629dc-9a1f-4a3c-ac85-b2237aaa554c tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:41.913709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-567629dc-9a1f-4a3c-ac85-b2237aaa554c tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:41.913709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-567629dc-9a1f-4a3c-ac85-b2237aaa554c tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:41.917907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-567629dc-9a1f-4a3c-ac85-b2237aaa554c tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:41.918474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-567629dc-9a1f-4a3c-ac85-b2237aaa554c tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:42.671889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-462a77c9-605b-457b-b42e-bc97df63f365 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:42.692254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-462a77c9-605b-457b-b42e-bc97df63f365 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:42.696948 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-567629dc-9a1f-4a3c-ac85-b2237aaa554c tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:42.707478 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-462a77c9-605b-457b-b42e-bc97df63f365 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:42.708899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-462a77c9-605b-457b-b42e-bc97df63f365 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 0.937613 Apr 16 16:52:42.714206 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-567629dc-9a1f-4a3c-ac85-b2237aaa554c tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.845928 Apr 16 16:52:42.725090 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 256/472] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:41 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:42.738450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 217/473] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:41 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:42.744269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ef3b8a31-8e1c-4079-9d87-8d53f4a702de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:42.748853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-941c6518-52f9-45f5-8c08-d3e7a571c56b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:42.750434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-941c6518-52f9-45f5-8c08-d3e7a571c56b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:42.751406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ef3b8a31-8e1c-4079-9d87-8d53f4a702de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:42.764179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef3b8a31-8e1c-4079-9d87-8d53f4a702de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:42.764718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef3b8a31-8e1c-4079-9d87-8d53f4a702de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:42.766318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef3b8a31-8e1c-4079-9d87-8d53f4a702de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:42.767986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef3b8a31-8e1c-4079-9d87-8d53f4a702de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:42.778695 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-941c6518-52f9-45f5-8c08-d3e7a571c56b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:42.786384 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-941c6518-52f9-45f5-8c08-d3e7a571c56b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:42.786384 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-941c6518-52f9-45f5-8c08-d3e7a571c56b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:42.786384 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-941c6518-52f9-45f5-8c08-d3e7a571c56b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:44.088018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-941c6518-52f9-45f5-8c08-d3e7a571c56b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:44.096196 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ef3b8a31-8e1c-4079-9d87-8d53f4a702de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:44.100303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-941c6518-52f9-45f5-8c08-d3e7a571c56b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1728 microversion: 2.1 time: 1.384202 Apr 16 16:52:44.100972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 257/474] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:42 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1728 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:44.111923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ef3b8a31-8e1c-4079-9d87-8d53f4a702de tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1521 microversion: 2.1 time: 1.369788 Apr 16 16:52:44.123517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 218/475] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:42 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1521 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:44.128493 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-56e4be44-8fb9-4793-b62c-b1f584670bde req-77315c6c-ef74-4512-b75d-477fa8d8615c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5", "name": "network-vif-plugged", "status": "completed", "tag": "ee6c6c28-4fef-436e-a001-4f66a8ffef9d"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:44.130953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:52:44.130953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:52:44.131973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-456b06d3-6b6b-406c-aa45-b7d5bf950d22 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:44.132826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-456b06d3-6b6b-406c-aa45-b7d5bf950d22 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:44.141279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-456b06d3-6b6b-406c-aa45-b7d5bf950d22 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:44.141754 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-456b06d3-6b6b-406c-aa45-b7d5bf950d22 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:44.144039 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-456b06d3-6b6b-406c-aa45-b7d5bf950d22 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:44.144757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-456b06d3-6b6b-406c-aa45-b7d5bf950d22 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:44.159295 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-56e4be44-8fb9-4793-b62c-b1f584670bde req-77315c6c-ef74-4512-b75d-477fa8d8615c service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:44.159886 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-56e4be44-8fb9-4793-b62c-b1f584670bde req-77315c6c-ef74-4512-b75d-477fa8d8615c service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:44.207189 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-56e4be44-8fb9-4793-b62c-b1f584670bde req-77315c6c-ef74-4512-b75d-477fa8d8615c service nova] Creating event network-vif-plugged:ee6c6c28-4fef-436e-a001-4f66a8ffef9d for instance e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 on hv-cinder-73362 Apr 16 16:52:44.221904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-56e4be44-8fb9-4793-b62c-b1f584670bde req-77315c6c-ef74-4512-b75d-477fa8d8615c service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107435 Apr 16 16:52:44.222901 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 258/476] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:52:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:44.234190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-46cf55a9-8321-46d7-a006-de45158507d8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:44.234190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-46cf55a9-8321-46d7-a006-de45158507d8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:44.276318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46cf55a9-8321-46d7-a006-de45158507d8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:44.277058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46cf55a9-8321-46d7-a006-de45158507d8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:44.278137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46cf55a9-8321-46d7-a006-de45158507d8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:44.278701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46cf55a9-8321-46d7-a006-de45158507d8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:44.469024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-456b06d3-6b6b-406c-aa45-b7d5bf950d22 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:44.481700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-456b06d3-6b6b-406c-aa45-b7d5bf950d22 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 0.356543 Apr 16 16:52:44.482347 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 219/477] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:44 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:44.504107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-da28685f-391a-45b8-b363-13b78131a49b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61303cb5-e35c-4f83-9d8a-b3c717e0ac6f"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:44.511567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-da28685f-391a-45b8-b363-13b78131a49b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:44.561417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da28685f-391a-45b8-b363-13b78131a49b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:44.572544 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da28685f-391a-45b8-b363-13b78131a49b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:44.575829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da28685f-391a-45b8-b363-13b78131a49b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:44.578900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da28685f-391a-45b8-b363-13b78131a49b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:44.980980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-46cf55a9-8321-46d7-a006-de45158507d8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:45.008455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-46cf55a9-8321-46d7-a006-de45158507d8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:45.012807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-46cf55a9-8321-46d7-a006-de45158507d8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:45.015390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-46cf55a9-8321-46d7-a006-de45158507d8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 0.790697 Apr 16 16:52:45.016596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 259/478] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:44 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:45.123270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-77f299c9-4936-4e07-973c-d31f998e4f61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:45.123918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-77f299c9-4936-4e07-973c-d31f998e4f61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:45.155492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77f299c9-4936-4e07-973c-d31f998e4f61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:45.156663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77f299c9-4936-4e07-973c-d31f998e4f61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:45.160465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77f299c9-4936-4e07-973c-d31f998e4f61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:45.161301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77f299c9-4936-4e07-973c-d31f998e4f61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:45.661356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-da28685f-391a-45b8-b363-13b78131a49b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.176985 Apr 16 16:52:45.667165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 220/479] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:52:44 2021] POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/os-volume_attachments => generated 194 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:52:45.708670 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dc32a6a5-21bf-4ee3-91d6-7e8940722597 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:45.711295 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dc32a6a5-21bf-4ee3-91d6-7e8940722597 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:45.780381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc32a6a5-21bf-4ee3-91d6-7e8940722597 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:45.782945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc32a6a5-21bf-4ee3-91d6-7e8940722597 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:45.785173 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc32a6a5-21bf-4ee3-91d6-7e8940722597 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:45.794146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc32a6a5-21bf-4ee3-91d6-7e8940722597 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:46.955534 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-77f299c9-4936-4e07-973c-d31f998e4f61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:46.969766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-77f299c9-4936-4e07-973c-d31f998e4f61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1728 microversion: 2.1 time: 1.853714 Apr 16 16:52:46.978466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 260/480] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:45 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1728 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:46.987062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e533e77c-4178-4e5b-8c84-3c0423c313d5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:46.989816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e533e77c-4178-4e5b-8c84-3c0423c313d5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:47.012821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e533e77c-4178-4e5b-8c84-3c0423c313d5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:47.019606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e533e77c-4178-4e5b-8c84-3c0423c313d5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:47.020804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e533e77c-4178-4e5b-8c84-3c0423c313d5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:47.021443 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e533e77c-4178-4e5b-8c84-3c0423c313d5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:47.060764 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dc32a6a5-21bf-4ee3-91d6-7e8940722597 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:47.077203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dc32a6a5-21bf-4ee3-91d6-7e8940722597 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1260 microversion: 2.1 time: 1.404898 Apr 16 16:52:47.087157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 221/481] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:45 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1260 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:47.991728 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f12ef14f-76d4-4a52-91a3-2a80b66b0c95 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:47.992718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f12ef14f-76d4-4a52-91a3-2a80b66b0c95 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:48.006121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f12ef14f-76d4-4a52-91a3-2a80b66b0c95 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:48.006928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f12ef14f-76d4-4a52-91a3-2a80b66b0c95 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:48.009159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f12ef14f-76d4-4a52-91a3-2a80b66b0c95 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:48.009864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f12ef14f-76d4-4a52-91a3-2a80b66b0c95 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:48.136102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e533e77c-4178-4e5b-8c84-3c0423c313d5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:48.165088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e533e77c-4178-4e5b-8c84-3c0423c313d5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:48.180040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e533e77c-4178-4e5b-8c84-3c0423c313d5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:48.181737 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e533e77c-4178-4e5b-8c84-3c0423c313d5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 1.202115 Apr 16 16:52:48.184828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 261/482] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:46 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:48.198120 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e1fb54b2-ac6b-463e-9f5f-fdf17fce129a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:48.204407 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e1fb54b2-ac6b-463e-9f5f-fdf17fce129a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:48.236686 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1fb54b2-ac6b-463e-9f5f-fdf17fce129a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:48.244077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1fb54b2-ac6b-463e-9f5f-fdf17fce129a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:48.245329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1fb54b2-ac6b-463e-9f5f-fdf17fce129a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:48.248750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1fb54b2-ac6b-463e-9f5f-fdf17fce129a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:48.990618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f12ef14f-76d4-4a52-91a3-2a80b66b0c95 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:49.006592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f12ef14f-76d4-4a52-91a3-2a80b66b0c95 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1728 microversion: 2.1 time: 1.018864 Apr 16 16:52:49.008841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 222/483] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:47 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1728 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:52:49.214167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-78fb9b68-497e-44e7-a012-a7d81dbbde58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:49.215320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-78fb9b68-497e-44e7-a012-a7d81dbbde58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:49.231431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-78fb9b68-497e-44e7-a012-a7d81dbbde58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:49.232029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-78fb9b68-497e-44e7-a012-a7d81dbbde58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:49.232965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-78fb9b68-497e-44e7-a012-a7d81dbbde58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:49.237073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-78fb9b68-497e-44e7-a012-a7d81dbbde58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:50.604954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e1fb54b2-ac6b-463e-9f5f-fdf17fce129a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:50.628382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e1fb54b2-ac6b-463e-9f5f-fdf17fce129a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1445 microversion: 2.1 time: 2.441899 Apr 16 16:52:50.633455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 262/484] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:48 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1445 bytes in 2448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:50.662033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f57ebd5e-54d6-4246-8354-13fc0e69b971 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:50.664418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f57ebd5e-54d6-4246-8354-13fc0e69b971 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:50.686022 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f57ebd5e-54d6-4246-8354-13fc0e69b971 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:50.688359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f57ebd5e-54d6-4246-8354-13fc0e69b971 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:50.693113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f57ebd5e-54d6-4246-8354-13fc0e69b971 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:50.694182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f57ebd5e-54d6-4246-8354-13fc0e69b971 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:51.666747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-78fb9b68-497e-44e7-a012-a7d81dbbde58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:51.681679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-78fb9b68-497e-44e7-a012-a7d81dbbde58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:51.684669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-78fb9b68-497e-44e7-a012-a7d81dbbde58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:51.686239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-78fb9b68-497e-44e7-a012-a7d81dbbde58 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 2.476285 Apr 16 16:52:51.699541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 223/485] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:49 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:51.705794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-519dffe0-7e7e-4bd3-b637-9ea9a81c5862 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:51.707025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-519dffe0-7e7e-4bd3-b637-9ea9a81c5862 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:51.716127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-519dffe0-7e7e-4bd3-b637-9ea9a81c5862 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:51.717010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-519dffe0-7e7e-4bd3-b637-9ea9a81c5862 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:51.718096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-519dffe0-7e7e-4bd3-b637-9ea9a81c5862 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:51.719577 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-519dffe0-7e7e-4bd3-b637-9ea9a81c5862 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:52.016913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f57ebd5e-54d6-4246-8354-13fc0e69b971 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:52.029915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f57ebd5e-54d6-4246-8354-13fc0e69b971 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1728 microversion: 2.1 time: 1.394877 Apr 16 16:52:52.030568 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 263/486] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:50 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1728 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:52.049076 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-07c1b947-966e-4fe3-90d8-5e2742e84711 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:52.049873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-07c1b947-966e-4fe3-90d8-5e2742e84711 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:52.066620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07c1b947-966e-4fe3-90d8-5e2742e84711 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:52.067306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07c1b947-966e-4fe3-90d8-5e2742e84711 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:52.074706 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07c1b947-966e-4fe3-90d8-5e2742e84711 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:52.075423 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07c1b947-966e-4fe3-90d8-5e2742e84711 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:52.388477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-07c1b947-966e-4fe3-90d8-5e2742e84711 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lazy-loading 'services' on Instance uuid 352dbe2a-d325-41eb-808c-36a4534b171b {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:52:52.719977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-07c1b947-966e-4fe3-90d8-5e2742e84711 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "DELETE /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b/os-volume_attachments/f35cac76-ffaa-479b-be57-9dce0ef983d0" status: 202 len: 0 microversion: 2.1 time: 0.685634 Apr 16 16:52:52.721356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 264/487] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 16:52:52 2021] DELETE /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b/os-volume_attachments/f35cac76-ffaa-479b-be57-9dce0ef983d0 => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:52:52.747236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-63b6237d-904d-4b35-ba51-604f5ecead7a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:52.748151 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-63b6237d-904d-4b35-ba51-604f5ecead7a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:52.788631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63b6237d-904d-4b35-ba51-604f5ecead7a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:52.789199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63b6237d-904d-4b35-ba51-604f5ecead7a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:52.802709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63b6237d-904d-4b35-ba51-604f5ecead7a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:52.803505 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63b6237d-904d-4b35-ba51-604f5ecead7a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:53.618499 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-519dffe0-7e7e-4bd3-b637-9ea9a81c5862 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:53.636386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-519dffe0-7e7e-4bd3-b637-9ea9a81c5862 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1445 microversion: 2.1 time: 1.935002 Apr 16 16:52:53.637209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 224/488] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:51 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1445 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:53.648174 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6a018ee6-9b4f-446c-862b-8a25bf8b92b9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:53.651858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6a018ee6-9b4f-446c-862b-8a25bf8b92b9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:53.667806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6a018ee6-9b4f-446c-862b-8a25bf8b92b9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:53.668523 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6a018ee6-9b4f-446c-862b-8a25bf8b92b9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:53.669728 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6a018ee6-9b4f-446c-862b-8a25bf8b92b9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:53.670494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6a018ee6-9b4f-446c-862b-8a25bf8b92b9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:53.929593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-63b6237d-904d-4b35-ba51-604f5ecead7a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:53.947723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-63b6237d-904d-4b35-ba51-604f5ecead7a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:53.955914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-63b6237d-904d-4b35-ba51-604f5ecead7a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:53.957651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-63b6237d-904d-4b35-ba51-604f5ecead7a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 1.230379 Apr 16 16:52:53.960623 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 265/489] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:52 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:54.280956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6a018ee6-9b4f-446c-862b-8a25bf8b92b9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:54.295396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6a018ee6-9b4f-446c-862b-8a25bf8b92b9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1728 microversion: 2.1 time: 0.656910 Apr 16 16:52:54.296055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 225/490] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:53 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1728 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:54.988259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d295a269-9db3-4cba-9702-aa56f9a30d31 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:54.989873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d295a269-9db3-4cba-9702-aa56f9a30d31 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:55.005244 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d295a269-9db3-4cba-9702-aa56f9a30d31 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:55.006533 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d295a269-9db3-4cba-9702-aa56f9a30d31 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:55.008018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d295a269-9db3-4cba-9702-aa56f9a30d31 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:55.010018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d295a269-9db3-4cba-9702-aa56f9a30d31 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:55.314098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8c137c88-d18a-4e7b-8733-8e15ba5132d2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:55.317808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8c137c88-d18a-4e7b-8733-8e15ba5132d2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:55.342899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8c137c88-d18a-4e7b-8733-8e15ba5132d2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:55.344224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8c137c88-d18a-4e7b-8733-8e15ba5132d2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:55.346549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8c137c88-d18a-4e7b-8733-8e15ba5132d2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:55.350477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8c137c88-d18a-4e7b-8733-8e15ba5132d2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:56.231894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d295a269-9db3-4cba-9702-aa56f9a30d31 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:56.238189 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8c137c88-d18a-4e7b-8733-8e15ba5132d2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:56.247595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d295a269-9db3-4cba-9702-aa56f9a30d31 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:56.260565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d295a269-9db3-4cba-9702-aa56f9a30d31 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:56.263515 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8c137c88-d18a-4e7b-8733-8e15ba5132d2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1728 microversion: 2.1 time: 0.954028 Apr 16 16:52:56.264843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d295a269-9db3-4cba-9702-aa56f9a30d31 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 1.285849 Apr 16 16:52:56.264974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 226/491] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:55 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1728 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:56.294312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 266/492] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:54 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:52:57.286229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e37e6dff-a5ed-4fb5-87e0-33fee4a91d6a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:57.288797 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e37e6dff-a5ed-4fb5-87e0-33fee4a91d6a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:57.307153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e37e6dff-a5ed-4fb5-87e0-33fee4a91d6a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:57.307671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9f783029-a462-486d-bddc-198a9fc69485 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:52:57.308461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9f783029-a462-486d-bddc-198a9fc69485 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:57.309220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e37e6dff-a5ed-4fb5-87e0-33fee4a91d6a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:57.314238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e37e6dff-a5ed-4fb5-87e0-33fee4a91d6a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:57.315077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e37e6dff-a5ed-4fb5-87e0-33fee4a91d6a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:57.333204 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f783029-a462-486d-bddc-198a9fc69485 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:57.337166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f783029-a462-486d-bddc-198a9fc69485 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:57.339730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f783029-a462-486d-bddc-198a9fc69485 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:57.340357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f783029-a462-486d-bddc-198a9fc69485 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:59.409276 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e37e6dff-a5ed-4fb5-87e0-33fee4a91d6a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:59.433647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e37e6dff-a5ed-4fb5-87e0-33fee4a91d6a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1728 microversion: 2.1 time: 2.152276 Apr 16 16:52:59.442239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 227/493] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:52:57 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1728 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:52:59.451172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8466b867-9d65-4f53-94a8-0c9ad8de3aec tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:52:59.452381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8466b867-9d65-4f53-94a8-0c9ad8de3aec tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:52:59.488267 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8466b867-9d65-4f53-94a8-0c9ad8de3aec tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:59.489027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8466b867-9d65-4f53-94a8-0c9ad8de3aec tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:59.490061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8466b867-9d65-4f53-94a8-0c9ad8de3aec tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:52:59.495004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8466b867-9d65-4f53-94a8-0c9ad8de3aec tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:52:59.620628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-8466b867-9d65-4f53-94a8-0c9ad8de3aec tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lazy-loading 'flavor' on Instance uuid 139562a9-bb46-4937-898d-cf6179ddc48d {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:52:59.649614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9f783029-a462-486d-bddc-198a9fc69485 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:59.671941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9f783029-a462-486d-bddc-198a9fc69485 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:59.687082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9f783029-a462-486d-bddc-198a9fc69485 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:52:59.694981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9f783029-a462-486d-bddc-198a9fc69485 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1744 microversion: 2.20 time: 2.392074 Apr 16 16:52:59.700972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 267/494] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:52:57 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1744 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:00.200793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8466b867-9d65-4f53-94a8-0c9ad8de3aec tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/action" status: 200 len: 32 microversion: 2.1 time: 0.755809 Apr 16 16:53:00.202088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 228/495] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:52:59 2021] POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/action => generated 32 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:53:00.212602 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a7812684-f8af-4def-909a-39db2b733f5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:00.213367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a7812684-f8af-4def-909a-39db2b733f5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:00.240062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7812684-f8af-4def-909a-39db2b733f5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:00.240739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7812684-f8af-4def-909a-39db2b733f5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:00.241799 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7812684-f8af-4def-909a-39db2b733f5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:00.242436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7812684-f8af-4def-909a-39db2b733f5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:00.458553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b4daffd7-d84c-4363-a4ac-e2a084ee5859 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:00.460104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b4daffd7-d84c-4363-a4ac-e2a084ee5859 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:00.484061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4daffd7-d84c-4363-a4ac-e2a084ee5859 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:00.489918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4daffd7-d84c-4363-a4ac-e2a084ee5859 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:00.491514 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4daffd7-d84c-4363-a4ac-e2a084ee5859 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:00.494984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4daffd7-d84c-4363-a4ac-e2a084ee5859 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:01.771687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a7812684-f8af-4def-909a-39db2b733f5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:01.791214 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a7812684-f8af-4def-909a-39db2b733f5b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 1.582987 Apr 16 16:53:01.793656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 268/496] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:00 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:01.802887 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0fc5828a-e526-4fde-a222-0ea784c8330c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:01.804749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0fc5828a-e526-4fde-a222-0ea784c8330c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:01.823532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b4daffd7-d84c-4363-a4ac-e2a084ee5859 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:01.837701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0fc5828a-e526-4fde-a222-0ea784c8330c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:01.838697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0fc5828a-e526-4fde-a222-0ea784c8330c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:01.842584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0fc5828a-e526-4fde-a222-0ea784c8330c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:01.843811 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0fc5828a-e526-4fde-a222-0ea784c8330c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:01.859284 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b4daffd7-d84c-4363-a4ac-e2a084ee5859 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1705 microversion: 2.1 time: 1.408295 Apr 16 16:53:01.860005 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 229/497] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:00 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1705 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:01.865630 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-76b8be08-4e42-43cb-adf9-ef44fe648c46 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:01.866177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-76b8be08-4e42-43cb-adf9-ef44fe648c46 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:01.884596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-76b8be08-4e42-43cb-adf9-ef44fe648c46 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:01.885110 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-76b8be08-4e42-43cb-adf9-ef44fe648c46 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:01.885974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-76b8be08-4e42-43cb-adf9-ef44fe648c46 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:01.886503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-76b8be08-4e42-43cb-adf9-ef44fe648c46 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:02.016738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-76b8be08-4e42-43cb-adf9-ef44fe648c46 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Going to try to terminate instance {{(pid=99399) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:53:02.197471 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-76b8be08-4e42-43cb-adf9-ef44fe648c46 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "DELETE /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 204 len: 0 microversion: 2.1 time: 0.336022 Apr 16 16:53:02.199249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 230/498] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:53:01 2021] DELETE /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:53:02.207343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ff58db5c-6d2a-4c94-b9d4-e5e592cc0e51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:02.216406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff58db5c-6d2a-4c94-b9d4-e5e592cc0e51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:02.217166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff58db5c-6d2a-4c94-b9d4-e5e592cc0e51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:02.290449 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ff58db5c-6d2a-4c94-b9d4-e5e592cc0e51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Going to try to start instance {{(pid=99399) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 16 16:53:02.463465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ff58db5c-6d2a-4c94-b9d4-e5e592cc0e51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 202 len: 0 microversion: 2.1 time: 0.261344 Apr 16 16:53:02.467932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 231/499] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:53:02 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:53:02.480170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e44d65c0-d375-4fe4-abf8-7ebad01e1b03 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:02.480970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e44d65c0-d375-4fe4-abf8-7ebad01e1b03 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:02.510866 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e44d65c0-d375-4fe4-abf8-7ebad01e1b03 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:02.517734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e44d65c0-d375-4fe4-abf8-7ebad01e1b03 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:02.518908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e44d65c0-d375-4fe4-abf8-7ebad01e1b03 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:02.519492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e44d65c0-d375-4fe4-abf8-7ebad01e1b03 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:02.929306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0fc5828a-e526-4fde-a222-0ea784c8330c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:02.945139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0fc5828a-e526-4fde-a222-0ea784c8330c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:02.947805 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0fc5828a-e526-4fde-a222-0ea784c8330c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:02.949774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0fc5828a-e526-4fde-a222-0ea784c8330c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1726 microversion: 2.20 time: 1.154606 Apr 16 16:53:02.950440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 269/500] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:01 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1726 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:02.970839 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8bfa364f-8c80-4f05-bc14-4a0b522e1060 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:02.973385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8bfa364f-8c80-4f05-bc14-4a0b522e1060 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:02.989361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bfa364f-8c80-4f05-bc14-4a0b522e1060 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:02.989981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bfa364f-8c80-4f05-bc14-4a0b522e1060 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:02.991784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bfa364f-8c80-4f05-bc14-4a0b522e1060 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:02.992763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bfa364f-8c80-4f05-bc14-4a0b522e1060 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:03.610832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e44d65c0-d375-4fe4-abf8-7ebad01e1b03 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:03.630009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e44d65c0-d375-4fe4-abf8-7ebad01e1b03 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1517 microversion: 2.1 time: 1.161757 Apr 16 16:53:03.631517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 232/501] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:02 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1517 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:03.640835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-665e7a3c-9f41-4cec-8ba5-9254901d0b17 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:03.647871 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-665e7a3c-9f41-4cec-8ba5-9254901d0b17 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:03.675161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-665e7a3c-9f41-4cec-8ba5-9254901d0b17 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:03.675859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-665e7a3c-9f41-4cec-8ba5-9254901d0b17 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:03.677006 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-665e7a3c-9f41-4cec-8ba5-9254901d0b17 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:03.677890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-665e7a3c-9f41-4cec-8ba5-9254901d0b17 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:04.200976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8bfa364f-8c80-4f05-bc14-4a0b522e1060 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:04.219357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8bfa364f-8c80-4f05-bc14-4a0b522e1060 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1714 microversion: 2.1 time: 1.258979 Apr 16 16:53:04.223199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 270/502] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:02 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1714 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:04.231051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c00a26d3-0a9b-482a-94ca-be648b3f4334 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:04.232720 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c00a26d3-0a9b-482a-94ca-be648b3f4334 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:04.244230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c00a26d3-0a9b-482a-94ca-be648b3f4334 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:04.245150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c00a26d3-0a9b-482a-94ca-be648b3f4334 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:04.246498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c00a26d3-0a9b-482a-94ca-be648b3f4334 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:04.247209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c00a26d3-0a9b-482a-94ca-be648b3f4334 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:04.987077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-665e7a3c-9f41-4cec-8ba5-9254901d0b17 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:05.015092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-665e7a3c-9f41-4cec-8ba5-9254901d0b17 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 1.374346 Apr 16 16:53:05.016418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 233/503] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:03 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:05.022574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-eb98cbca-4a63-4a20-ab4a-30e92bc25772 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:05.025860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-eb98cbca-4a63-4a20-ab4a-30e92bc25772 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:05.050039 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eb98cbca-4a63-4a20-ab4a-30e92bc25772 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:05.053722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eb98cbca-4a63-4a20-ab4a-30e92bc25772 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:05.055393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eb98cbca-4a63-4a20-ab4a-30e92bc25772 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:05.058410 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eb98cbca-4a63-4a20-ab4a-30e92bc25772 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:06.356198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c00a26d3-0a9b-482a-94ca-be648b3f4334 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:06.399224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c00a26d3-0a9b-482a-94ca-be648b3f4334 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:06.405898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c00a26d3-0a9b-482a-94ca-be648b3f4334 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:06.413815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c00a26d3-0a9b-482a-94ca-be648b3f4334 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1726 microversion: 2.20 time: 2.186207 Apr 16 16:53:06.415617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 271/504] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:04 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1726 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:06.426733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-466226f3-8c3e-4dc0-8145-e94c5db66a97 req-694674e4-722a-44bb-ba49-1e40cef4602e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5", "tag": "ee6c6c28-4fef-436e-a001-4f66a8ffef9d"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:06.446210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:53:06.446210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:53:06.480073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-466226f3-8c3e-4dc0-8145-e94c5db66a97 req-694674e4-722a-44bb-ba49-1e40cef4602e service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:06.483483 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-466226f3-8c3e-4dc0-8145-e94c5db66a97 req-694674e4-722a-44bb-ba49-1e40cef4602e service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:06.547022 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-eb98cbca-4a63-4a20-ab4a-30e92bc25772 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:06.559303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-eb98cbca-4a63-4a20-ab4a-30e92bc25772 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1517 microversion: 2.1 time: 1.541377 Apr 16 16:53:06.571092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-466226f3-8c3e-4dc0-8145-e94c5db66a97 req-694674e4-722a-44bb-ba49-1e40cef4602e service nova] Creating event network-changed:ee6c6c28-4fef-436e-a001-4f66a8ffef9d for instance e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 on hv-cinder-73362 Apr 16 16:53:06.571952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 234/505] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:05 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1517 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:06.586980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-466226f3-8c3e-4dc0-8145-e94c5db66a97 req-694674e4-722a-44bb-ba49-1e40cef4602e service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167018 Apr 16 16:53:06.591788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 272/506] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:53:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:06.600796 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-123d14e8-c79d-439a-b6a8-55bed179fe60 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:06.601565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-123d14e8-c79d-439a-b6a8-55bed179fe60 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:06.608368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-d30a784c-7c66-485c-b35e-c506d5c4716b req-18c3492e-f5a2-4192-87f2-889228b4bf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf021fce-d230-4117-992c-f91cd978276c", "name": "network-vif-unplugged", "status": "completed", "tag": "fd825542-a1af-4ba6-8c00-d64d5199c7e6"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:06.612995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:53:06.612995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:53:06.631439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-123d14e8-c79d-439a-b6a8-55bed179fe60 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:06.636420 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-d30a784c-7c66-485c-b35e-c506d5c4716b req-18c3492e-f5a2-4192-87f2-889228b4bf80 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:06.638141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-123d14e8-c79d-439a-b6a8-55bed179fe60 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:06.639107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-123d14e8-c79d-439a-b6a8-55bed179fe60 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:06.639578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-123d14e8-c79d-439a-b6a8-55bed179fe60 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:06.651257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-d30a784c-7c66-485c-b35e-c506d5c4716b req-18c3492e-f5a2-4192-87f2-889228b4bf80 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:06.695372 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-d30a784c-7c66-485c-b35e-c506d5c4716b req-18c3492e-f5a2-4192-87f2-889228b4bf80 service nova] Creating event network-vif-unplugged:fd825542-a1af-4ba6-8c00-d64d5199c7e6 for instance bf021fce-d230-4117-992c-f91cd978276c on hv-cinder-73362 Apr 16 16:53:06.711474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-d30a784c-7c66-485c-b35e-c506d5c4716b req-18c3492e-f5a2-4192-87f2-889228b4bf80 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117560 Apr 16 16:53:06.714846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 273/507] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:53:06 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:06.731276 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c1c71e65-7e9e-4e2f-8d7a-b3949f4bff65 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:06.733556 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c1c71e65-7e9e-4e2f-8d7a-b3949f4bff65 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:06.760346 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1c71e65-7e9e-4e2f-8d7a-b3949f4bff65 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:06.760851 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1c71e65-7e9e-4e2f-8d7a-b3949f4bff65 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:06.761715 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1c71e65-7e9e-4e2f-8d7a-b3949f4bff65 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:06.762203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1c71e65-7e9e-4e2f-8d7a-b3949f4bff65 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:07.482320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c1c71e65-7e9e-4e2f-8d7a-b3949f4bff65 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:07.497791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c1c71e65-7e9e-4e2f-8d7a-b3949f4bff65 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.776802 Apr 16 16:53:07.498889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 274/508] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:06 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:07.507564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-de694410-4a75-459e-ac09-f88b797c57c6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:07.508245 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-de694410-4a75-459e-ac09-f88b797c57c6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:07.526675 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de694410-4a75-459e-ac09-f88b797c57c6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:07.527408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de694410-4a75-459e-ac09-f88b797c57c6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:07.528404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de694410-4a75-459e-ac09-f88b797c57c6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:07.529072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de694410-4a75-459e-ac09-f88b797c57c6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:07.639673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-123d14e8-c79d-439a-b6a8-55bed179fe60 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:07.686077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-123d14e8-c79d-439a-b6a8-55bed179fe60 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1714 microversion: 2.1 time: 1.112831 Apr 16 16:53:07.690056 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 235/509] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:06 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1714 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:07.702005 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dc681f13-adae-4293-b260-9b03350006a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:07.703078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dc681f13-adae-4293-b260-9b03350006a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:07.717419 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc681f13-adae-4293-b260-9b03350006a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:07.718118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc681f13-adae-4293-b260-9b03350006a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:07.719067 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc681f13-adae-4293-b260-9b03350006a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:07.719569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc681f13-adae-4293-b260-9b03350006a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:08.575633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-de694410-4a75-459e-ac09-f88b797c57c6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:08.603895 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-de694410-4a75-459e-ac09-f88b797c57c6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:08.611367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-de694410-4a75-459e-ac09-f88b797c57c6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:08.628454 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-de694410-4a75-459e-ac09-f88b797c57c6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1726 microversion: 2.20 time: 1.128572 Apr 16 16:53:08.629911 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 275/510] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:07 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1726 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:08.641357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3e84545d-9692-426d-b1e8-bb8109a7592f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:08.656068 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3e84545d-9692-426d-b1e8-bb8109a7592f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:08.689446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3e84545d-9692-426d-b1e8-bb8109a7592f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:08.690116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3e84545d-9692-426d-b1e8-bb8109a7592f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:08.691465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3e84545d-9692-426d-b1e8-bb8109a7592f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:08.692036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3e84545d-9692-426d-b1e8-bb8109a7592f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:09.747317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dc681f13-adae-4293-b260-9b03350006a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:09.767363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dc681f13-adae-4293-b260-9b03350006a0 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1517 microversion: 2.1 time: 2.069233 Apr 16 16:53:09.768911 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 236/511] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:07 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1517 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:09.775114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-550015c7-e727-4725-bebd-efcd814587fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:09.776363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-550015c7-e727-4725-bebd-efcd814587fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:09.786225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-550015c7-e727-4725-bebd-efcd814587fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:09.787140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-550015c7-e727-4725-bebd-efcd814587fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:09.788961 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-550015c7-e727-4725-bebd-efcd814587fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:09.790127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-550015c7-e727-4725-bebd-efcd814587fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:10.117388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3e84545d-9692-426d-b1e8-bb8109a7592f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:10.128196 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3e84545d-9692-426d-b1e8-bb8109a7592f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 1.493209 Apr 16 16:53:10.129188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 276/512] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:08 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:10.135364 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-17a4b66d-1137-49a2-b340-24c557cc2fac req-a4dd1af0-2ff7-452e-931e-947422a250bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "352dbe2a-d325-41eb-808c-36a4534b171b", "name": "network-vif-unplugged", "status": "completed", "tag": "51b8feb1-4963-4f27-81af-59dd11a082f7"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:10.137220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:53:10.137220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:53:10.147545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-17a4b66d-1137-49a2-b340-24c557cc2fac req-a4dd1af0-2ff7-452e-931e-947422a250bb service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:10.148140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-17a4b66d-1137-49a2-b340-24c557cc2fac req-a4dd1af0-2ff7-452e-931e-947422a250bb service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:10.177316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-17a4b66d-1137-49a2-b340-24c557cc2fac req-a4dd1af0-2ff7-452e-931e-947422a250bb service nova] Creating event network-vif-unplugged:51b8feb1-4963-4f27-81af-59dd11a082f7 for instance 352dbe2a-d325-41eb-808c-36a4534b171b on hv-cinder-73362 Apr 16 16:53:10.182754 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-17a4b66d-1137-49a2-b340-24c557cc2fac req-a4dd1af0-2ff7-452e-931e-947422a250bb service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051938 Apr 16 16:53:10.183842 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 277/513] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:53:10 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:10.191955 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-114bf9b6-c692-4c16-8c5b-06c8de2c15bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:10.193179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-114bf9b6-c692-4c16-8c5b-06c8de2c15bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:10.202213 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-114bf9b6-c692-4c16-8c5b-06c8de2c15bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:10.203404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-114bf9b6-c692-4c16-8c5b-06c8de2c15bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:10.203960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-114bf9b6-c692-4c16-8c5b-06c8de2c15bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:10.205699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-114bf9b6-c692-4c16-8c5b-06c8de2c15bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:10.977010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-550015c7-e727-4725-bebd-efcd814587fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:11.043714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-550015c7-e727-4725-bebd-efcd814587fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1718 microversion: 2.1 time: 1.271985 Apr 16 16:53:11.046962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 237/514] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:09 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1718 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:11.074769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0b20d09c-258f-4a40-b9a7-c83b56004d76 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:11.075939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0b20d09c-258f-4a40-b9a7-c83b56004d76 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:11.098674 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b20d09c-258f-4a40-b9a7-c83b56004d76 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:11.099184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b20d09c-258f-4a40-b9a7-c83b56004d76 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:11.100063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b20d09c-258f-4a40-b9a7-c83b56004d76 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:11.103874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b20d09c-258f-4a40-b9a7-c83b56004d76 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:11.185244 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-114bf9b6-c692-4c16-8c5b-06c8de2c15bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:11.198898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-114bf9b6-c692-4c16-8c5b-06c8de2c15bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:11.200599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-114bf9b6-c692-4c16-8c5b-06c8de2c15bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:11.201836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-114bf9b6-c692-4c16-8c5b-06c8de2c15bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1669 microversion: 2.20 time: 1.014758 Apr 16 16:53:11.223065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 278/515] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:10 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1669 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:11.233357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5b259c5f-ff63-4fac-b54c-ca82d9da3440 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:11.234037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5b259c5f-ff63-4fac-b54c-ca82d9da3440 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:11.251829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b259c5f-ff63-4fac-b54c-ca82d9da3440 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:11.254966 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b259c5f-ff63-4fac-b54c-ca82d9da3440 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:11.256055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b259c5f-ff63-4fac-b54c-ca82d9da3440 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:11.258908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b259c5f-ff63-4fac-b54c-ca82d9da3440 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:11.493558 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0b20d09c-258f-4a40-b9a7-c83b56004d76 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:11.511105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0b20d09c-258f-4a40-b9a7-c83b56004d76 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1475 microversion: 2.1 time: 0.452125 Apr 16 16:53:11.512183 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 238/516] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:11 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1475 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:11.527440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b8376aea-70f8-4bc7-b08f-007d81fbffa0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cacc271b-eb4b-453e-9f43-7637f2372c09"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:11.528401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b8376aea-70f8-4bc7-b08f-007d81fbffa0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:11.544139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8376aea-70f8-4bc7-b08f-007d81fbffa0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:11.544139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8376aea-70f8-4bc7-b08f-007d81fbffa0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:11.544781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8376aea-70f8-4bc7-b08f-007d81fbffa0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:11.546999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8376aea-70f8-4bc7-b08f-007d81fbffa0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:12.072513 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5b259c5f-ff63-4fac-b54c-ca82d9da3440 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:12.098174 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5b259c5f-ff63-4fac-b54c-ca82d9da3440 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.873682 Apr 16 16:53:12.104052 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 279/517] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:11 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:12.125285 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-be62d04c-14a6-4b88-ad65-afd8ba25e1a4 req-3e1c5aa5-e38d-4719-8998-addb9f74f0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "352dbe2a-d325-41eb-808c-36a4534b171b", "name": "network-vif-deleted", "tag": "51b8feb1-4963-4f27-81af-59dd11a082f7"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:12.128094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:53:12.128094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:53:12.148008 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-be62d04c-14a6-4b88-ad65-afd8ba25e1a4 req-3e1c5aa5-e38d-4719-8998-addb9f74f0d5 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:12.148468 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-be62d04c-14a6-4b88-ad65-afd8ba25e1a4 req-3e1c5aa5-e38d-4719-8998-addb9f74f0d5 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:12.168055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-be62d04c-14a6-4b88-ad65-afd8ba25e1a4 req-3e1c5aa5-e38d-4719-8998-addb9f74f0d5 service nova] Creating event network-vif-deleted:51b8feb1-4963-4f27-81af-59dd11a082f7 for instance 352dbe2a-d325-41eb-808c-36a4534b171b on hv-cinder-73362 Apr 16 16:53:12.173943 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-be62d04c-14a6-4b88-ad65-afd8ba25e1a4 req-3e1c5aa5-e38d-4719-8998-addb9f74f0d5 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052202 Apr 16 16:53:12.175182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 280/518] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:53:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:53:12.183421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 16:53:12.183574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 16:53:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 16:53:12.390661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b8376aea-70f8-4bc7-b08f-007d81fbffa0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.877182 Apr 16 16:53:12.393073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 239/519] 10.222.0.103 () {62 vars in 1359 bytes} [Fri Apr 16 16:53:11 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/os-volume_attachments => generated 188 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:53:12.552182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-18588209-948b-4352-afa1-d355ddf2c7c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:12.552814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-18588209-948b-4352-afa1-d355ddf2c7c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:12.555310 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b7f55d49-1965-4fb2-8839-8dd33a63a0ca tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:12.556115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b7f55d49-1965-4fb2-8839-8dd33a63a0ca tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:12.571472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7f55d49-1965-4fb2-8839-8dd33a63a0ca tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:12.571977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7f55d49-1965-4fb2-8839-8dd33a63a0ca tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:12.572836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7f55d49-1965-4fb2-8839-8dd33a63a0ca tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:12.573320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7f55d49-1965-4fb2-8839-8dd33a63a0ca tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:12.575948 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-18588209-948b-4352-afa1-d355ddf2c7c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:12.576444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-18588209-948b-4352-afa1-d355ddf2c7c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:12.577412 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-18588209-948b-4352-afa1-d355ddf2c7c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:12.577895 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-18588209-948b-4352-afa1-d355ddf2c7c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:12.818638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-18588209-948b-4352-afa1-d355ddf2c7c3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action" status: 202 len: 0 microversion: 2.20 time: 0.273096 Apr 16 16:53:12.822881 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 240/520] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:53:12 2021] POST /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:53:12.829594 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-297ed9f1-cec0-4b5d-b6e5-68bad5cb1f97 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:12.830680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-297ed9f1-cec0-4b5d-b6e5-68bad5cb1f97 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:12.839222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-297ed9f1-cec0-4b5d-b6e5-68bad5cb1f97 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:12.839741 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-297ed9f1-cec0-4b5d-b6e5-68bad5cb1f97 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:12.840743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-297ed9f1-cec0-4b5d-b6e5-68bad5cb1f97 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:12.841312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-297ed9f1-cec0-4b5d-b6e5-68bad5cb1f97 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:12.908743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b7f55d49-1965-4fb2-8839-8dd33a63a0ca tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:12.925336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b7f55d49-1965-4fb2-8839-8dd33a63a0ca tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1475 microversion: 2.1 time: 0.383586 Apr 16 16:53:12.926368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 281/521] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:12 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1475 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:13.121761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f87847f2-2b43-4627-b461-df10655ee52f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:13.122441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f87847f2-2b43-4627-b461-df10655ee52f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:13.137876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f87847f2-2b43-4627-b461-df10655ee52f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:13.138763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f87847f2-2b43-4627-b461-df10655ee52f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:13.139698 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f87847f2-2b43-4627-b461-df10655ee52f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:13.140527 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f87847f2-2b43-4627-b461-df10655ee52f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:13.753019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-297ed9f1-cec0-4b5d-b6e5-68bad5cb1f97 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:13.780674 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-297ed9f1-cec0-4b5d-b6e5-68bad5cb1f97 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:13.782719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-297ed9f1-cec0-4b5d-b6e5-68bad5cb1f97 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:13.785147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-297ed9f1-cec0-4b5d-b6e5-68bad5cb1f97 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1755 microversion: 2.20 time: 0.960292 Apr 16 16:53:13.785931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 241/522] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:12 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1755 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:13.945109 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4539bd1a-b7b3-47f6-9376-5a24254f6712 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:13.945841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4539bd1a-b7b3-47f6-9376-5a24254f6712 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:13.958643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4539bd1a-b7b3-47f6-9376-5a24254f6712 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:13.959696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4539bd1a-b7b3-47f6-9376-5a24254f6712 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:13.961014 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4539bd1a-b7b3-47f6-9376-5a24254f6712 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:13.964154 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4539bd1a-b7b3-47f6-9376-5a24254f6712 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:14.135689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f87847f2-2b43-4627-b461-df10655ee52f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:14.145205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4539bd1a-b7b3-47f6-9376-5a24254f6712 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:14.145504 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f87847f2-2b43-4627-b461-df10655ee52f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 1.028240 Apr 16 16:53:14.146204 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 282/523] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:13 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:14.155567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4539bd1a-b7b3-47f6-9376-5a24254f6712 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1307 microversion: 2.1 time: 0.214889 Apr 16 16:53:14.156784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 242/524] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:13 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1307 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:14.686112 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-42420982-7201-4bd5-855a-654343236b59 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Action: 'create', calling method: .version_select at 0x7f0d46205bf8>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-680428694"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:14.710489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-42420982-7201-4bd5-855a-654343236b59 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Getting quotas for project 215e50567539412caa22fd5000dc74a6. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:53:14.714855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-42420982-7201-4bd5-855a-654343236b59 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Getting quotas for user 33d512498d26488895520590b4b2ea1d and project 215e50567539412caa22fd5000dc74a6. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:53:14.804924 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2e528c27-667d-40ac-94da-f2294cea9864 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:14.805497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2e528c27-667d-40ac-94da-f2294cea9864 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:14.813451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e528c27-667d-40ac-94da-f2294cea9864 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:14.813942 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e528c27-667d-40ac-94da-f2294cea9864 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:14.814810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e528c27-667d-40ac-94da-f2294cea9864 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:14.815290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e528c27-667d-40ac-94da-f2294cea9864 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:15.066245 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2e528c27-667d-40ac-94da-f2294cea9864 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:15.088256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2e528c27-667d-40ac-94da-f2294cea9864 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:15.090472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2e528c27-667d-40ac-94da-f2294cea9864 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:15.091864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2e528c27-667d-40ac-94da-f2294cea9864 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1755 microversion: 2.20 time: 0.291210 Apr 16 16:53:15.093115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 243/525] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:14 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1755 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:15.183967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-047a62ed-d58b-4c2c-8f25-9ef6e20939f0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:15.184770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-047a62ed-d58b-4c2c-8f25-9ef6e20939f0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:15.193965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-047a62ed-d58b-4c2c-8f25-9ef6e20939f0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:15.194743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-047a62ed-d58b-4c2c-8f25-9ef6e20939f0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:15.195762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-047a62ed-d58b-4c2c-8f25-9ef6e20939f0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:15.196742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-047a62ed-d58b-4c2c-8f25-9ef6e20939f0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:15.333364 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-42420982-7201-4bd5-855a-654343236b59 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Getting quotas for project 215e50567539412caa22fd5000dc74a6. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:53:15.339024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-42420982-7201-4bd5-855a-654343236b59 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Getting quotas for user 33d512498d26488895520590b4b2ea1d and project 215e50567539412caa22fd5000dc74a6. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:53:15.357372 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-42420982-7201-4bd5-855a-654343236b59 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.795274 Apr 16 16:53:15.358068 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 283/526] 10.222.0.103 () {60 vars in 1153 bytes} [Fri Apr 16 16:53:14 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:15.377725 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:15.378516 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:15.403187 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:15.403705 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:15.404572 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:15.405071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:15.488835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:15.489610 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:15.490309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lazy-loading 'fault' on Instance uuid 352dbe2a-d325-41eb-808c-36a4534b171b {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:53:15.497106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-047a62ed-d58b-4c2c-8f25-9ef6e20939f0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:15.509028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-047a62ed-d58b-4c2c-8f25-9ef6e20939f0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.349031 Apr 16 16:53:15.509911 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 244/527] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:15 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:15.567807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:15.576972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bfa6b945-18c9-41af-97eb-cde3247f9aba tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 200 len: 1312 microversion: 2.1 time: 0.217477 Apr 16 16:53:15.578396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 284/528] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:15 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:16.115145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-86515f25-703a-438b-af8f-38a68f73d3e4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:16.116205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-86515f25-703a-438b-af8f-38a68f73d3e4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:16.129206 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-86515f25-703a-438b-af8f-38a68f73d3e4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:16.131020 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-86515f25-703a-438b-af8f-38a68f73d3e4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:16.134376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-86515f25-703a-438b-af8f-38a68f73d3e4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:16.135151 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-86515f25-703a-438b-af8f-38a68f73d3e4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:16.529582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b56e1117-c039-4a50-9a62-213d8c2da2ea tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:16.531300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b56e1117-c039-4a50-9a62-213d8c2da2ea tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:16.540400 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b56e1117-c039-4a50-9a62-213d8c2da2ea tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:16.541015 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b56e1117-c039-4a50-9a62-213d8c2da2ea tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:16.541920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b56e1117-c039-4a50-9a62-213d8c2da2ea tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:16.542709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b56e1117-c039-4a50-9a62-213d8c2da2ea tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:16.567960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-86515f25-703a-438b-af8f-38a68f73d3e4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:16.608599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-86515f25-703a-438b-af8f-38a68f73d3e4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:16.615171 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-86515f25-703a-438b-af8f-38a68f73d3e4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:16.619650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-86515f25-703a-438b-af8f-38a68f73d3e4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1757 microversion: 2.20 time: 0.509701 Apr 16 16:53:16.622501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 245/529] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:16 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1757 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:16.634040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-92f61e6f-1193-46fb-a5d0-3a1a634db7a7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:16.635593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-92f61e6f-1193-46fb-a5d0-3a1a634db7a7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 352dbe2a-d325-41eb-808c-36a4534b171b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:16.647474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-92f61e6f-1193-46fb-a5d0-3a1a634db7a7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:16.648134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-92f61e6f-1193-46fb-a5d0-3a1a634db7a7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:16.648988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-92f61e6f-1193-46fb-a5d0-3a1a634db7a7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:16.649483 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-92f61e6f-1193-46fb-a5d0-3a1a634db7a7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:16.710671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-92f61e6f-1193-46fb-a5d0-3a1a634db7a7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] HTTP exception thrown: Instance 352dbe2a-d325-41eb-808c-36a4534b171b could not be found. Apr 16 16:53:16.711623 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-92f61e6f-1193-46fb-a5d0-3a1a634db7a7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Returning 404 to user: Instance 352dbe2a-d325-41eb-808c-36a4534b171b could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:53:16.712533 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-92f61e6f-1193-46fb-a5d0-3a1a634db7a7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b" status: 404 len: 111 microversion: 2.1 time: 0.088313 Apr 16 16:53:16.713142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 246/530] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:16 2021] GET /compute/v2.1/servers/352dbe2a-d325-41eb-808c-36a4534b171b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:53:17.117608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b56e1117-c039-4a50-9a62-213d8c2da2ea tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:17.128350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b56e1117-c039-4a50-9a62-213d8c2da2ea tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.603397 Apr 16 16:53:17.129007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 285/531] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:16 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:17.648062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cc08a07f-8081-4fec-beba-d308d104288f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:17.650688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cc08a07f-8081-4fec-beba-d308d104288f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:17.666650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc08a07f-8081-4fec-beba-d308d104288f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:17.670117 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc08a07f-8081-4fec-beba-d308d104288f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:17.671326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc08a07f-8081-4fec-beba-d308d104288f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:17.672144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc08a07f-8081-4fec-beba-d308d104288f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:17.979321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cc08a07f-8081-4fec-beba-d308d104288f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:17.996213 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cc08a07f-8081-4fec-beba-d308d104288f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:17.998198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cc08a07f-8081-4fec-beba-d308d104288f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:17.999716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cc08a07f-8081-4fec-beba-d308d104288f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1757 microversion: 2.20 time: 0.362343 Apr 16 16:53:18.000480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 247/532] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:17 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1757 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:18.007030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-071be4bf-bdc4-4764-b42e-0f19da588266 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:18.007595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-071be4bf-bdc4-4764-b42e-0f19da588266 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:18.017259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-071be4bf-bdc4-4764-b42e-0f19da588266 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:18.018373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-071be4bf-bdc4-4764-b42e-0f19da588266 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:18.019882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-071be4bf-bdc4-4764-b42e-0f19da588266 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:18.020600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-071be4bf-bdc4-4764-b42e-0f19da588266 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:18.115943 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-071be4bf-bdc4-4764-b42e-0f19da588266 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:53:18.147934 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-90235da4-d3ed-40bb-bb8e-7a2c17b54e2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:18.148921 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-90235da4-d3ed-40bb-bb8e-7a2c17b54e2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:18.161659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90235da4-d3ed-40bb-bb8e-7a2c17b54e2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:18.163986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90235da4-d3ed-40bb-bb8e-7a2c17b54e2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:18.166000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90235da4-d3ed-40bb-bb8e-7a2c17b54e2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:18.170132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90235da4-d3ed-40bb-bb8e-7a2c17b54e2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:18.277845 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-071be4bf-bdc4-4764-b42e-0f19da588266 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "DELETE /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 204 len: 0 microversion: 2.1 time: 0.282116 Apr 16 16:53:18.278581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 286/533] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:53:17 2021] DELETE /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:53:18.289995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a019ad3b-c775-4eb9-98bb-d20e1256df99 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:18.290916 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a019ad3b-c775-4eb9-98bb-d20e1256df99 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:18.301679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a019ad3b-c775-4eb9-98bb-d20e1256df99 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:18.302222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a019ad3b-c775-4eb9-98bb-d20e1256df99 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:18.303166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a019ad3b-c775-4eb9-98bb-d20e1256df99 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:18.304001 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a019ad3b-c775-4eb9-98bb-d20e1256df99 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:18.576548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-90235da4-d3ed-40bb-bb8e-7a2c17b54e2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:18.592455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-90235da4-d3ed-40bb-bb8e-7a2c17b54e2d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.448651 Apr 16 16:53:18.594477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 248/534] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:18 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:18.685089 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a019ad3b-c775-4eb9-98bb-d20e1256df99 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:18.696423 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a019ad3b-c775-4eb9-98bb-d20e1256df99 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1517 microversion: 2.1 time: 0.411556 Apr 16 16:53:18.701925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 287/535] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:18 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1517 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:19.023173 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ceb98f86-1325-442f-96ec-c4cae8580ddf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:19.023995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ceb98f86-1325-442f-96ec-c4cae8580ddf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:19.040644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ceb98f86-1325-442f-96ec-c4cae8580ddf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:19.041450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ceb98f86-1325-442f-96ec-c4cae8580ddf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:19.043301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ceb98f86-1325-442f-96ec-c4cae8580ddf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:19.043976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ceb98f86-1325-442f-96ec-c4cae8580ddf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:19.590872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ceb98f86-1325-442f-96ec-c4cae8580ddf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:19.607634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ceb98f86-1325-442f-96ec-c4cae8580ddf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:19.614248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4d1933c9-75ba-4743-9027-13c8fb93157e tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:19.615579 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4d1933c9-75ba-4743-9027-13c8fb93157e tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:19.619430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ceb98f86-1325-442f-96ec-c4cae8580ddf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:19.628863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ceb98f86-1325-442f-96ec-c4cae8580ddf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.611933 Apr 16 16:53:19.629683 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 249/536] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:19 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:19.634454 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d1933c9-75ba-4743-9027-13c8fb93157e tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:19.656125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d1933c9-75ba-4743-9027-13c8fb93157e tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:19.657221 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d1933c9-75ba-4743-9027-13c8fb93157e tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:19.657751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4d1933c9-75ba-4743-9027-13c8fb93157e tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:19.723448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b5054fa8-8e2e-447c-a897-c8512a0816fc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:19.724181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b5054fa8-8e2e-447c-a897-c8512a0816fc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:19.742132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5054fa8-8e2e-447c-a897-c8512a0816fc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:19.742941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5054fa8-8e2e-447c-a897-c8512a0816fc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:19.744000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5054fa8-8e2e-447c-a897-c8512a0816fc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:19.744652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5054fa8-8e2e-447c-a897-c8512a0816fc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:20.294935 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4d1933c9-75ba-4743-9027-13c8fb93157e tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:20.316004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4d1933c9-75ba-4743-9027-13c8fb93157e tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.706159 Apr 16 16:53:20.327312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 288/537] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:19 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:20.347284 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b5054fa8-8e2e-447c-a897-c8512a0816fc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:20.361592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b5054fa8-8e2e-447c-a897-c8512a0816fc tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1517 microversion: 2.1 time: 0.643654 Apr 16 16:53:20.364044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 250/538] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:19 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1517 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:20.648977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-34e7229d-8cdd-4a6f-8766-5a54a6aa74cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:20.649774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-34e7229d-8cdd-4a6f-8766-5a54a6aa74cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:20.667398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34e7229d-8cdd-4a6f-8766-5a54a6aa74cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:20.668407 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34e7229d-8cdd-4a6f-8766-5a54a6aa74cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:20.670073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34e7229d-8cdd-4a6f-8766-5a54a6aa74cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:20.671109 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34e7229d-8cdd-4a6f-8766-5a54a6aa74cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:21.005473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-34e7229d-8cdd-4a6f-8766-5a54a6aa74cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:21.017598 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-34e7229d-8cdd-4a6f-8766-5a54a6aa74cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:21.019162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-34e7229d-8cdd-4a6f-8766-5a54a6aa74cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:21.021144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-34e7229d-8cdd-4a6f-8766-5a54a6aa74cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.375973 Apr 16 16:53:21.027009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 289/539] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:20 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:21.346253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ebe381a4-04e4-43de-846c-2a6419191f66 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:21.346908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ebe381a4-04e4-43de-846c-2a6419191f66 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:21.355631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ebe381a4-04e4-43de-846c-2a6419191f66 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:21.356143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ebe381a4-04e4-43de-846c-2a6419191f66 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:21.357002 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ebe381a4-04e4-43de-846c-2a6419191f66 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:21.357736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ebe381a4-04e4-43de-846c-2a6419191f66 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:21.382331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-32421b60-ab53-467f-955e-3447cec741d8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:21.383049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-32421b60-ab53-467f-955e-3447cec741d8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:21.400402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32421b60-ab53-467f-955e-3447cec741d8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:21.403658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32421b60-ab53-467f-955e-3447cec741d8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:21.404367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32421b60-ab53-467f-955e-3447cec741d8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:21.404884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32421b60-ab53-467f-955e-3447cec741d8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:22.148230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ebe381a4-04e4-43de-846c-2a6419191f66 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:22.168970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ebe381a4-04e4-43de-846c-2a6419191f66 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.827062 Apr 16 16:53:22.186316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 251/540] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:21 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:22.193864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0e015b5a-10fe-40cd-9ba4-ab36ec85ead0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:22.194979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0e015b5a-10fe-40cd-9ba4-ab36ec85ead0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:22.211724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e015b5a-10fe-40cd-9ba4-ab36ec85ead0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:22.212593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e015b5a-10fe-40cd-9ba4-ab36ec85ead0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:22.214455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e015b5a-10fe-40cd-9ba4-ab36ec85ead0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:22.215327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e015b5a-10fe-40cd-9ba4-ab36ec85ead0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:22.259853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-32421b60-ab53-467f-955e-3447cec741d8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:22.295687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-32421b60-ab53-467f-955e-3447cec741d8 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1517 microversion: 2.1 time: 0.918213 Apr 16 16:53:22.296862 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 290/541] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:21 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1517 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:22.842601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0e015b5a-10fe-40cd-9ba4-ab36ec85ead0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:22.856949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0e015b5a-10fe-40cd-9ba4-ab36ec85ead0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:22.859922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0e015b5a-10fe-40cd-9ba4-ab36ec85ead0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:22.862440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0e015b5a-10fe-40cd-9ba4-ab36ec85ead0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.677656 Apr 16 16:53:22.863680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 252/542] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:22 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:23.198671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5acf0d29-5aa4-46b9-b6eb-c90b5275c94c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:23.199305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5acf0d29-5aa4-46b9-b6eb-c90b5275c94c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:23.210092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5acf0d29-5aa4-46b9-b6eb-c90b5275c94c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:23.211276 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5acf0d29-5aa4-46b9-b6eb-c90b5275c94c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:23.212412 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5acf0d29-5aa4-46b9-b6eb-c90b5275c94c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:23.213008 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5acf0d29-5aa4-46b9-b6eb-c90b5275c94c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:23.330925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-72a96b22-22fa-41e8-9df4-9d9630abcc2c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:23.331667 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-72a96b22-22fa-41e8-9df4-9d9630abcc2c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:23.339910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-72a96b22-22fa-41e8-9df4-9d9630abcc2c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:23.340855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-72a96b22-22fa-41e8-9df4-9d9630abcc2c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:23.341222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-72a96b22-22fa-41e8-9df4-9d9630abcc2c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:23.341586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-72a96b22-22fa-41e8-9df4-9d9630abcc2c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:23.592267 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5acf0d29-5aa4-46b9-b6eb-c90b5275c94c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:23.606519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5acf0d29-5aa4-46b9-b6eb-c90b5275c94c tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.409025 Apr 16 16:53:23.606519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 291/543] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:23 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:23.709447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-72a96b22-22fa-41e8-9df4-9d9630abcc2c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:23.719672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-72a96b22-22fa-41e8-9df4-9d9630abcc2c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1517 microversion: 2.1 time: 0.394428 Apr 16 16:53:23.721083 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 253/544] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:23 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1517 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:23.882967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ebb33b41-2ff1-4295-924e-0195c4de3e30 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:23.883640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ebb33b41-2ff1-4295-924e-0195c4de3e30 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:23.895559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ebb33b41-2ff1-4295-924e-0195c4de3e30 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:23.896074 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ebb33b41-2ff1-4295-924e-0195c4de3e30 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:23.896952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ebb33b41-2ff1-4295-924e-0195c4de3e30 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:23.897458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ebb33b41-2ff1-4295-924e-0195c4de3e30 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:24.231799 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ebb33b41-2ff1-4295-924e-0195c4de3e30 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:24.243162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ebb33b41-2ff1-4295-924e-0195c4de3e30 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:24.244864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ebb33b41-2ff1-4295-924e-0195c4de3e30 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:24.246125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ebb33b41-2ff1-4295-924e-0195c4de3e30 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.367736 Apr 16 16:53:24.247031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 292/545] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:23 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:53:24.645576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2b6cc007-3f26-479d-b1b3-42d55ed92022 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:24.646300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2b6cc007-3f26-479d-b1b3-42d55ed92022 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:24.674324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b6cc007-3f26-479d-b1b3-42d55ed92022 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:24.675607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b6cc007-3f26-479d-b1b3-42d55ed92022 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:24.676715 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b6cc007-3f26-479d-b1b3-42d55ed92022 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:24.677370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b6cc007-3f26-479d-b1b3-42d55ed92022 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:24.739119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a19085f0-77ec-4567-8062-ecb45809ac7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:24.740060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a19085f0-77ec-4567-8062-ecb45809ac7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:24.758139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a19085f0-77ec-4567-8062-ecb45809ac7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:24.763677 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a19085f0-77ec-4567-8062-ecb45809ac7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:24.764870 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a19085f0-77ec-4567-8062-ecb45809ac7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:24.765534 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a19085f0-77ec-4567-8062-ecb45809ac7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:25.383350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2b6cc007-3f26-479d-b1b3-42d55ed92022 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:25.412003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a19085f0-77ec-4567-8062-ecb45809ac7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:25.412199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2b6cc007-3f26-479d-b1b3-42d55ed92022 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.789069 Apr 16 16:53:25.413161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 254/546] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:24 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:25.426252 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a19085f0-77ec-4567-8062-ecb45809ac7d tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1517 microversion: 2.1 time: 0.692114 Apr 16 16:53:25.431822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-63688fe8-c9ff-49a7-9e79-473aa2a59f8e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:25.432432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-63688fe8-c9ff-49a7-9e79-473aa2a59f8e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:25.439656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 293/547] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:24 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1517 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:25.443610 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63688fe8-c9ff-49a7-9e79-473aa2a59f8e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:25.444231 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63688fe8-c9ff-49a7-9e79-473aa2a59f8e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:25.445165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63688fe8-c9ff-49a7-9e79-473aa2a59f8e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:25.445675 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63688fe8-c9ff-49a7-9e79-473aa2a59f8e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:25.812558 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-63688fe8-c9ff-49a7-9e79-473aa2a59f8e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:25.850452 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-63688fe8-c9ff-49a7-9e79-473aa2a59f8e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:25.852250 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-63688fe8-c9ff-49a7-9e79-473aa2a59f8e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:25.853717 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-63688fe8-c9ff-49a7-9e79-473aa2a59f8e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.426643 Apr 16 16:53:25.857469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 255/548] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:25 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:26.434178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d19192d2-88c1-42a9-ba03-0002376ed35f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:26.435472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d19192d2-88c1-42a9-ba03-0002376ed35f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:26.446355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e9fcc125-5d0e-444a-b616-dc2b101e2bc2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:26.447385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e9fcc125-5d0e-444a-b616-dc2b101e2bc2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:26.464222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9fcc125-5d0e-444a-b616-dc2b101e2bc2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:26.464427 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d19192d2-88c1-42a9-ba03-0002376ed35f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:26.464633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9fcc125-5d0e-444a-b616-dc2b101e2bc2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:26.465011 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d19192d2-88c1-42a9-ba03-0002376ed35f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:26.466566 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d19192d2-88c1-42a9-ba03-0002376ed35f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:26.467224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d19192d2-88c1-42a9-ba03-0002376ed35f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:26.468830 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9fcc125-5d0e-444a-b616-dc2b101e2bc2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:26.478326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e9fcc125-5d0e-444a-b616-dc2b101e2bc2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:26.872169 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d19192d2-88c1-42a9-ba03-0002376ed35f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:26.885582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d19192d2-88c1-42a9-ba03-0002376ed35f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.455604 Apr 16 16:53:26.886746 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 294/549] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:26 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:26.901694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-721afad5-180f-4a35-9579-49c97a16f145 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:26.903211 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-721afad5-180f-4a35-9579-49c97a16f145 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:26.914846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-721afad5-180f-4a35-9579-49c97a16f145 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:26.915579 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-721afad5-180f-4a35-9579-49c97a16f145 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:26.915700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e9fcc125-5d0e-444a-b616-dc2b101e2bc2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:26.916834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-721afad5-180f-4a35-9579-49c97a16f145 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:26.917661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-721afad5-180f-4a35-9579-49c97a16f145 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:26.925035 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e9fcc125-5d0e-444a-b616-dc2b101e2bc2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1517 microversion: 2.1 time: 0.483193 Apr 16 16:53:26.926142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 256/550] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:26 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1517 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:27.246893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-721afad5-180f-4a35-9579-49c97a16f145 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:27.259757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-721afad5-180f-4a35-9579-49c97a16f145 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:27.261476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-721afad5-180f-4a35-9579-49c97a16f145 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:27.262866 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-721afad5-180f-4a35-9579-49c97a16f145 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.374710 Apr 16 16:53:27.278883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 295/551] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:26 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:27.910124 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a327d459-8481-4b8a-b768-f980aeaf740b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:27.911452 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a327d459-8481-4b8a-b768-f980aeaf740b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:27.920536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a327d459-8481-4b8a-b768-f980aeaf740b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:27.921341 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a327d459-8481-4b8a-b768-f980aeaf740b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:27.922816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a327d459-8481-4b8a-b768-f980aeaf740b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:27.923590 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a327d459-8481-4b8a-b768-f980aeaf740b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:27.949923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-328954fe-ce21-4c3f-8eb1-fecd3b37bea9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:27.951178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-328954fe-ce21-4c3f-8eb1-fecd3b37bea9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:28.001332 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-328954fe-ce21-4c3f-8eb1-fecd3b37bea9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:28.002538 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-328954fe-ce21-4c3f-8eb1-fecd3b37bea9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:28.017279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-328954fe-ce21-4c3f-8eb1-fecd3b37bea9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:28.019121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-328954fe-ce21-4c3f-8eb1-fecd3b37bea9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:30.133253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-328954fe-ce21-4c3f-8eb1-fecd3b37bea9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:30.151462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-328954fe-ce21-4c3f-8eb1-fecd3b37bea9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1517 microversion: 2.1 time: 2.207459 Apr 16 16:53:30.153567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 296/552] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:27 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1517 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:30.160331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ff476a08-8510-4151-8543-12faab9f9196 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:30.161429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ff476a08-8510-4151-8543-12faab9f9196 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:30.170890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff476a08-8510-4151-8543-12faab9f9196 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:30.174428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff476a08-8510-4151-8543-12faab9f9196 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:30.174428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff476a08-8510-4151-8543-12faab9f9196 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:30.174428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ff476a08-8510-4151-8543-12faab9f9196 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:30.354163 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a327d459-8481-4b8a-b768-f980aeaf740b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:30.366236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a327d459-8481-4b8a-b768-f980aeaf740b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 2.461925 Apr 16 16:53:30.366897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 257/553] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:27 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:30.838968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ff476a08-8510-4151-8543-12faab9f9196 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:30.853017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ff476a08-8510-4151-8543-12faab9f9196 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:30.855119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ff476a08-8510-4151-8543-12faab9f9196 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:30.856360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ff476a08-8510-4151-8543-12faab9f9196 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.701088 Apr 16 16:53:30.857072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 297/554] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:30 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:31.171166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dc7db69c-42e5-45c2-b84d-262f3259dab2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:31.173076 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dc7db69c-42e5-45c2-b84d-262f3259dab2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:31.199045 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc7db69c-42e5-45c2-b84d-262f3259dab2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:31.206725 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc7db69c-42e5-45c2-b84d-262f3259dab2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:31.207872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc7db69c-42e5-45c2-b84d-262f3259dab2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:31.217694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc7db69c-42e5-45c2-b84d-262f3259dab2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:31.385826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d1078cf1-d624-4ec2-b581-2896933f1357 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:31.386523 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d1078cf1-d624-4ec2-b581-2896933f1357 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:31.401467 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1078cf1-d624-4ec2-b581-2896933f1357 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:31.401993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1078cf1-d624-4ec2-b581-2896933f1357 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:31.407336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1078cf1-d624-4ec2-b581-2896933f1357 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:31.414442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1078cf1-d624-4ec2-b581-2896933f1357 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:31.992996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d1078cf1-d624-4ec2-b581-2896933f1357 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:32.006564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d1078cf1-d624-4ec2-b581-2896933f1357 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.624347 Apr 16 16:53:32.020296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dc7db69c-42e5-45c2-b84d-262f3259dab2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:32.028300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 298/555] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:31 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:32.033002 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dc7db69c-42e5-45c2-b84d-262f3259dab2 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1517 microversion: 2.1 time: 0.866402 Apr 16 16:53:32.037007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1cf61e53-023c-45a8-b8d1-557d80ad412c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:32.037940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 258/556] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:31 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1517 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:32.038918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1cf61e53-023c-45a8-b8d1-557d80ad412c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:32.047244 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1cf61e53-023c-45a8-b8d1-557d80ad412c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:32.048936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1cf61e53-023c-45a8-b8d1-557d80ad412c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:32.050059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1cf61e53-023c-45a8-b8d1-557d80ad412c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:32.050886 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1cf61e53-023c-45a8-b8d1-557d80ad412c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:32.623087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1cf61e53-023c-45a8-b8d1-557d80ad412c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:32.656883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1cf61e53-023c-45a8-b8d1-557d80ad412c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:32.661406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1cf61e53-023c-45a8-b8d1-557d80ad412c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:32.663014 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1cf61e53-023c-45a8-b8d1-557d80ad412c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.633290 Apr 16 16:53:32.664092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 299/557] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:32 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:33.025328 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d1ac697e-33e1-4be9-9340-9e2ae99bae58 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:33.026019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d1ac697e-33e1-4be9-9340-9e2ae99bae58 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:33.034797 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1ac697e-33e1-4be9-9340-9e2ae99bae58 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:33.035270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1ac697e-33e1-4be9-9340-9e2ae99bae58 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:33.036276 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1ac697e-33e1-4be9-9340-9e2ae99bae58 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:33.036839 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d1ac697e-33e1-4be9-9340-9e2ae99bae58 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:33.058207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f59467b5-6af3-400a-a9b0-1e0e8461a628 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:33.058638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f59467b5-6af3-400a-a9b0-1e0e8461a628 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:33.067903 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f59467b5-6af3-400a-a9b0-1e0e8461a628 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:33.068408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f59467b5-6af3-400a-a9b0-1e0e8461a628 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:33.069252 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f59467b5-6af3-400a-a9b0-1e0e8461a628 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:33.069743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f59467b5-6af3-400a-a9b0-1e0e8461a628 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:33.397464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d1ac697e-33e1-4be9-9340-9e2ae99bae58 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:33.405613 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f59467b5-6af3-400a-a9b0-1e0e8461a628 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:33.411107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d1ac697e-33e1-4be9-9340-9e2ae99bae58 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 0.390176 Apr 16 16:53:33.412080 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 259/558] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:33 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:33.415894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f59467b5-6af3-400a-a9b0-1e0e8461a628 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1517 microversion: 2.1 time: 0.364065 Apr 16 16:53:33.416661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 300/559] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:33 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1517 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:33.684529 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6afa7b7f-671a-4ce7-ab43-1db270c00803 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:33.684898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6afa7b7f-671a-4ce7-ab43-1db270c00803 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:33.694253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6afa7b7f-671a-4ce7-ab43-1db270c00803 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:33.694800 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6afa7b7f-671a-4ce7-ab43-1db270c00803 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:33.695634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6afa7b7f-671a-4ce7-ab43-1db270c00803 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:33.696097 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6afa7b7f-671a-4ce7-ab43-1db270c00803 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:34.045355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6afa7b7f-671a-4ce7-ab43-1db270c00803 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:34.067131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6afa7b7f-671a-4ce7-ab43-1db270c00803 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:34.068909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6afa7b7f-671a-4ce7-ab43-1db270c00803 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:34.070237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6afa7b7f-671a-4ce7-ab43-1db270c00803 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.390745 Apr 16 16:53:34.070874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 260/560] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:33 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:34.430607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-251f9732-e2fe-4ad5-924a-2bc9086a3dc0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:34.431891 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-251f9732-e2fe-4ad5-924a-2bc9086a3dc0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:34.435617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-80cd5e34-700d-44ba-9647-017192d34d8f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:34.436385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-80cd5e34-700d-44ba-9647-017192d34d8f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:34.442597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-251f9732-e2fe-4ad5-924a-2bc9086a3dc0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:34.443513 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-251f9732-e2fe-4ad5-924a-2bc9086a3dc0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:34.444553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-251f9732-e2fe-4ad5-924a-2bc9086a3dc0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:34.445269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-251f9732-e2fe-4ad5-924a-2bc9086a3dc0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:34.449341 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80cd5e34-700d-44ba-9647-017192d34d8f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:34.449931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80cd5e34-700d-44ba-9647-017192d34d8f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:34.451040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80cd5e34-700d-44ba-9647-017192d34d8f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:34.451733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-80cd5e34-700d-44ba-9647-017192d34d8f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:35.425226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-251f9732-e2fe-4ad5-924a-2bc9086a3dc0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:35.431399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-80cd5e34-700d-44ba-9647-017192d34d8f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:35.435826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-251f9732-e2fe-4ad5-924a-2bc9086a3dc0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1573 microversion: 2.1 time: 1.009562 Apr 16 16:53:35.436725 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 301/561] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:34 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1573 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:35.446986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-80cd5e34-700d-44ba-9647-017192d34d8f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1517 microversion: 2.1 time: 1.013434 Apr 16 16:53:35.446986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 261/562] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:34 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1517 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:35.449984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-192571b0-3e21-49a4-8288-16ff49de72cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:35.450815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-192571b0-3e21-49a4-8288-16ff49de72cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:35.460330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-192571b0-3e21-49a4-8288-16ff49de72cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:35.461121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-192571b0-3e21-49a4-8288-16ff49de72cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:35.462016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-192571b0-3e21-49a4-8288-16ff49de72cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:35.462540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-192571b0-3e21-49a4-8288-16ff49de72cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:36.119216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-192571b0-3e21-49a4-8288-16ff49de72cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:36.130488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-192571b0-3e21-49a4-8288-16ff49de72cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:36.132393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-192571b0-3e21-49a4-8288-16ff49de72cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:36.133849 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-192571b0-3e21-49a4-8288-16ff49de72cd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.688473 Apr 16 16:53:36.134622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 262/563] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:35 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:36.455196 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0ba08f14-1c35-4364-848c-5a8580f285b0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:36.456559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0ba08f14-1c35-4364-848c-5a8580f285b0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:36.465165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4819ac61-d78f-437b-8824-acc6860546ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:36.466141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4819ac61-d78f-437b-8824-acc6860546ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:36.467014 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ba08f14-1c35-4364-848c-5a8580f285b0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:36.467691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ba08f14-1c35-4364-848c-5a8580f285b0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:36.468721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ba08f14-1c35-4364-848c-5a8580f285b0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:36.469760 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ba08f14-1c35-4364-848c-5a8580f285b0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:36.476653 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4819ac61-d78f-437b-8824-acc6860546ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:36.477289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4819ac61-d78f-437b-8824-acc6860546ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:36.478482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4819ac61-d78f-437b-8824-acc6860546ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:36.479080 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4819ac61-d78f-437b-8824-acc6860546ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:36.740714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4819ac61-d78f-437b-8824-acc6860546ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:36.767234 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4819ac61-d78f-437b-8824-acc6860546ae tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 200 len: 1475 microversion: 2.1 time: 0.306801 Apr 16 16:53:36.768716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 263/564] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:36 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 1475 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:36.788292 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-874796d5-d1dd-48f1-b7c6-49c22f17d37b req-e7898682-a497-48f4-bf29-92b456993c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb60f26-2b88-48af-81dd-927c66dc681f", "name": "network-vif-deleted", "tag": "23369559-a855-4cb3-8ac2-eac8b5506e56"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:36.794531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:53:36.794531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:53:36.828230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-874796d5-d1dd-48f1-b7c6-49c22f17d37b req-e7898682-a497-48f4-bf29-92b456993c6d service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:36.829085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-874796d5-d1dd-48f1-b7c6-49c22f17d37b req-e7898682-a497-48f4-bf29-92b456993c6d service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:36.860672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-874796d5-d1dd-48f1-b7c6-49c22f17d37b req-e7898682-a497-48f4-bf29-92b456993c6d service nova] Creating event network-vif-deleted:23369559-a855-4cb3-8ac2-eac8b5506e56 for instance feb60f26-2b88-48af-81dd-927c66dc681f on hv-cinder-73362 Apr 16 16:53:36.869176 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0ba08f14-1c35-4364-848c-5a8580f285b0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:36.873767 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-874796d5-d1dd-48f1-b7c6-49c22f17d37b req-e7898682-a497-48f4-bf29-92b456993c6d service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103595 Apr 16 16:53:36.875232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 264/565] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:53:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:36.888571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0ba08f14-1c35-4364-848c-5a8580f285b0 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1553 microversion: 2.1 time: 0.437719 Apr 16 16:53:36.890469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 302/566] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:36 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1553 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:36.910333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fe83c7cd-fb64-4c43-a0dc-d4fb4822296a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:36.911107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fe83c7cd-fb64-4c43-a0dc-d4fb4822296a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:36.920366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fe83c7cd-fb64-4c43-a0dc-d4fb4822296a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:36.921021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fe83c7cd-fb64-4c43-a0dc-d4fb4822296a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:36.921995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fe83c7cd-fb64-4c43-a0dc-d4fb4822296a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:36.923483 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fe83c7cd-fb64-4c43-a0dc-d4fb4822296a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:37.171376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9e4e5411-b647-458e-a34a-4f6bf6c5dd84 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:37.182490 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9e4e5411-b647-458e-a34a-4f6bf6c5dd84 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:37.210235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9e4e5411-b647-458e-a34a-4f6bf6c5dd84 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:37.210882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9e4e5411-b647-458e-a34a-4f6bf6c5dd84 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:37.211997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9e4e5411-b647-458e-a34a-4f6bf6c5dd84 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:37.212693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9e4e5411-b647-458e-a34a-4f6bf6c5dd84 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:37.258531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-fe83c7cd-fb64-4c43-a0dc-d4fb4822296a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] HTTP exception thrown: Cannot 'detach_volume' instance 139562a9-bb46-4937-898d-cf6179ddc48d while it is in vm_state rescued Apr 16 16:53:37.263474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fe83c7cd-fb64-4c43-a0dc-d4fb4822296a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Returning 409 to user: Cannot 'detach_volume' instance 139562a9-bb46-4937-898d-cf6179ddc48d while it is in vm_state rescued {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:53:37.267700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fe83c7cd-fb64-4c43-a0dc-d4fb4822296a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "DELETE /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/os-volume_attachments/61303cb5-e35c-4f83-9d8a-b3c717e0ac6f" status: 409 len: 152 microversion: 2.1 time: 0.359561 Apr 16 16:53:37.270032 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 265/567] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 16:53:36 2021] DELETE /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/os-volume_attachments/61303cb5-e35c-4f83-9d8a-b3c717e0ac6f => generated 152 bytes in 365 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 16:53:37.290296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a9bdf471-409d-4806-bc04-56b4ab2697fe tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:37.293088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a9bdf471-409d-4806-bc04-56b4ab2697fe tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:37.318165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a9bdf471-409d-4806-bc04-56b4ab2697fe tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:37.319520 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a9bdf471-409d-4806-bc04-56b4ab2697fe tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:37.320639 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a9bdf471-409d-4806-bc04-56b4ab2697fe tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:37.321414 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a9bdf471-409d-4806-bc04-56b4ab2697fe tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:37.507919 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a9bdf471-409d-4806-bc04-56b4ab2697fe tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/action" status: 202 len: 0 microversion: 2.1 time: 0.227384 Apr 16 16:53:37.509397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 266/568] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:53:37 2021] POST /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:53:37.522867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6df5700e-776e-44bd-b5d0-84a9a44d9f6d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:37.524131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6df5700e-776e-44bd-b5d0-84a9a44d9f6d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:37.536827 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6df5700e-776e-44bd-b5d0-84a9a44d9f6d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:37.538488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6df5700e-776e-44bd-b5d0-84a9a44d9f6d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:37.539793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6df5700e-776e-44bd-b5d0-84a9a44d9f6d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:37.540640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6df5700e-776e-44bd-b5d0-84a9a44d9f6d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:37.793873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9e4e5411-b647-458e-a34a-4f6bf6c5dd84 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:37.807979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9e4e5411-b647-458e-a34a-4f6bf6c5dd84 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:37.810266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9e4e5411-b647-458e-a34a-4f6bf6c5dd84 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:37.812531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9e4e5411-b647-458e-a34a-4f6bf6c5dd84 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.660559 Apr 16 16:53:37.814392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 303/569] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:37 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:37.834581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-012c4172-52c9-4462-a564-422d986b2091 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:37.835911 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-012c4172-52c9-4462-a564-422d986b2091 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: feb60f26-2b88-48af-81dd-927c66dc681f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:37.847886 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-012c4172-52c9-4462-a564-422d986b2091 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:37.848592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-012c4172-52c9-4462-a564-422d986b2091 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:37.849775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-012c4172-52c9-4462-a564-422d986b2091 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:37.850430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-012c4172-52c9-4462-a564-422d986b2091 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:37.936915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-012c4172-52c9-4462-a564-422d986b2091 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] HTTP exception thrown: Instance feb60f26-2b88-48af-81dd-927c66dc681f could not be found. Apr 16 16:53:37.937789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-012c4172-52c9-4462-a564-422d986b2091 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Returning 404 to user: Instance feb60f26-2b88-48af-81dd-927c66dc681f could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:53:37.939841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-012c4172-52c9-4462-a564-422d986b2091 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f" status: 404 len: 111 microversion: 2.1 time: 0.118661 Apr 16 16:53:37.945061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 304/570] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:37 2021] GET /compute/v2.1/servers/feb60f26-2b88-48af-81dd-927c66dc681f => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:53:37.950874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4c82b2be-1486-49ce-9a8a-33c5c48c2b7c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:37.951600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4c82b2be-1486-49ce-9a8a-33c5c48c2b7c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:37.962078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4c82b2be-1486-49ce-9a8a-33c5c48c2b7c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:37.962651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4c82b2be-1486-49ce-9a8a-33c5c48c2b7c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:37.963627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4c82b2be-1486-49ce-9a8a-33c5c48c2b7c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:37.964266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4c82b2be-1486-49ce-9a8a-33c5c48c2b7c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:38.039576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6df5700e-776e-44bd-b5d0-84a9a44d9f6d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:38.055815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6df5700e-776e-44bd-b5d0-84a9a44d9f6d tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1561 microversion: 2.1 time: 0.539671 Apr 16 16:53:38.056433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4c82b2be-1486-49ce-9a8a-33c5c48c2b7c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:53:38.060487 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 267/571] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:37 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1561 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:38.235527 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4c82b2be-1486-49ce-9a8a-33c5c48c2b7c tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "DELETE /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 204 len: 0 microversion: 2.1 time: 0.286896 Apr 16 16:53:38.237179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 305/572] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:53:37 2021] DELETE /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:53:38.247608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-52598397-6e8e-4d3a-8092-5fb1dc4700cd tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:38.248270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-52598397-6e8e-4d3a-8092-5fb1dc4700cd tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:38.260500 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52598397-6e8e-4d3a-8092-5fb1dc4700cd tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:38.261021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52598397-6e8e-4d3a-8092-5fb1dc4700cd tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:38.261889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52598397-6e8e-4d3a-8092-5fb1dc4700cd tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:38.262409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52598397-6e8e-4d3a-8092-5fb1dc4700cd tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:38.448804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1224026373", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-680428694", "security_groups": [{"name": "tempest-secgroup-smoke-162326361"}], "block_device_mapping_v2": [{"uuid": "586e14dd-e1e5-428c-909a-51442e32e974", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4fdfd20a-86ba-40ff-badd-033e171b120f"}]}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:38.792294 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] validate_networks() for [('4fdfd20a-86ba-40ff-badd-033e171b120f', None, None, None)] {{(pid=99398) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:53:39.317035 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-52598397-6e8e-4d3a-8092-5fb1dc4700cd tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:39.333990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-52598397-6e8e-4d3a-8092-5fb1dc4700cd tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1517 microversion: 2.1 time: 1.090355 Apr 16 16:53:39.334835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 268/573] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:38 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1517 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:39.351202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-28d71477-1ac7-4891-a3ed-18a3b56d5a3f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:39.352188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-28d71477-1ac7-4891-a3ed-18a3b56d5a3f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:39.369475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28d71477-1ac7-4891-a3ed-18a3b56d5a3f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:39.382376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28d71477-1ac7-4891-a3ed-18a3b56d5a3f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:39.383909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28d71477-1ac7-4891-a3ed-18a3b56d5a3f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:39.384830 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28d71477-1ac7-4891-a3ed-18a3b56d5a3f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:40.087534 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Flavor limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:53:40.088059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Image limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:53:40.088507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Flavor pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:53:40.088960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Image pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:53:40.089424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:53:40.106075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:40.106843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:40.107897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:40.108543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:40.153736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Getting quotas for project 215e50567539412caa22fd5000dc74a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:53:40.168472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Getting quotas for user 33d512498d26488895520590b4b2ea1d and project 215e50567539412caa22fd5000dc74a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:53:40.346815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-28d71477-1ac7-4891-a3ed-18a3b56d5a3f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:40.361644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-28d71477-1ac7-4891-a3ed-18a3b56d5a3f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:40.365840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-28d71477-1ac7-4891-a3ed-18a3b56d5a3f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:40.367531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-28d71477-1ac7-4891-a3ed-18a3b56d5a3f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 1.030722 Apr 16 16:53:40.368336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 269/574] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:39 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:40.375468 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8ed2a556-5e43-47bb-a25e-551e5d9ed8e8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:40.376447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8ed2a556-5e43-47bb-a25e-551e5d9ed8e8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:40.385322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8ed2a556-5e43-47bb-a25e-551e5d9ed8e8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:40.386047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8ed2a556-5e43-47bb-a25e-551e5d9ed8e8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:40.387104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8ed2a556-5e43-47bb-a25e-551e5d9ed8e8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:40.387765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8ed2a556-5e43-47bb-a25e-551e5d9ed8e8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:40.517453 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Going to run 1 instances... {{(pid=99398) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:53:40.520237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='586e14dd-e1e5-428c-909a-51442e32e974',volume_size=None,volume_type=None)] {{(pid=99398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:53:40.671242 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8ed2a556-5e43-47bb-a25e-551e5d9ed8e8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:40.681963 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8ed2a556-5e43-47bb-a25e-551e5d9ed8e8 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1561 microversion: 2.1 time: 0.312253 Apr 16 16:53:40.683202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 270/575] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:40 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1561 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:40.687655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e3120464-c035-42c8-95f3-009d2cf2388f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:40.689318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e3120464-c035-42c8-95f3-009d2cf2388f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:40.697229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3120464-c035-42c8-95f3-009d2cf2388f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:40.697763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3120464-c035-42c8-95f3-009d2cf2388f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:40.698633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3120464-c035-42c8-95f3-009d2cf2388f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:40.699115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3120464-c035-42c8-95f3-009d2cf2388f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:40.751395 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-984b3664-2de6-4eba-8229-6030876a93e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.307574 Apr 16 16:53:40.752903 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 306/576] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:53:38 2021] POST /compute/v2.1/servers => generated 407 bytes in 2311 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 16 16:53:40.766748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2b6a33d1-7894-4393-913a-8a11d409c2fc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:40.767804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2b6a33d1-7894-4393-913a-8a11d409c2fc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:40.970969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2b6a33d1-7894-4393-913a-8a11d409c2fc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:40.981945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2b6a33d1-7894-4393-913a-8a11d409c2fc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1097 microversion: 2.1 time: 0.220572 Apr 16 16:53:40.986202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 307/577] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:40 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1097 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:41.100460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e3120464-c035-42c8-95f3-009d2cf2388f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:41.109634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e3120464-c035-42c8-95f3-009d2cf2388f tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1517 microversion: 2.1 time: 0.425734 Apr 16 16:53:41.110815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 271/578] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:40 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1517 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:41.388503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8137a691-d2d6-4d80-ba88-9262b1ab91f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:41.389547 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8137a691-d2d6-4d80-ba88-9262b1ab91f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:41.400299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8137a691-d2d6-4d80-ba88-9262b1ab91f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:41.401149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8137a691-d2d6-4d80-ba88-9262b1ab91f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:41.402234 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8137a691-d2d6-4d80-ba88-9262b1ab91f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:41.402983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8137a691-d2d6-4d80-ba88-9262b1ab91f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:41.708739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-32e95a11-1a10-4c6a-ae14-5218ecdf0d75 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:41.709744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-32e95a11-1a10-4c6a-ae14-5218ecdf0d75 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:41.727457 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32e95a11-1a10-4c6a-ae14-5218ecdf0d75 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:41.728301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32e95a11-1a10-4c6a-ae14-5218ecdf0d75 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:41.729571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32e95a11-1a10-4c6a-ae14-5218ecdf0d75 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:41.730835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-32e95a11-1a10-4c6a-ae14-5218ecdf0d75 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:42.416140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8137a691-d2d6-4d80-ba88-9262b1ab91f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:42.447970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8137a691-d2d6-4d80-ba88-9262b1ab91f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:42.449920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8137a691-d2d6-4d80-ba88-9262b1ab91f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:42.458684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8137a691-d2d6-4d80-ba88-9262b1ab91f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 1.074877 Apr 16 16:53:42.459362 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 308/579] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:41 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:42.481532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5c2c91bd-781c-4a6c-bae0-279daec587c8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:42.482904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5c2c91bd-781c-4a6c-bae0-279daec587c8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:42.515735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c2c91bd-781c-4a6c-bae0-279daec587c8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:42.516735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c2c91bd-781c-4a6c-bae0-279daec587c8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:42.518173 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c2c91bd-781c-4a6c-bae0-279daec587c8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:42.518856 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c2c91bd-781c-4a6c-bae0-279daec587c8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:42.589589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-32e95a11-1a10-4c6a-ae14-5218ecdf0d75 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:42.605223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-32e95a11-1a10-4c6a-ae14-5218ecdf0d75 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1561 microversion: 2.1 time: 0.907806 Apr 16 16:53:42.611923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 272/580] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:41 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1561 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:42.618388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:42.619313 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:42.640258 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:42.640819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:42.642497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:42.642747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:42.819286 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:42.819712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:42.820233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lazy-loading 'fault' on Instance uuid 9d6362be-f2e6-4f47-ae72-f6f8b12063dd {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:53:42.888454 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5c2c91bd-781c-4a6c-bae0-279daec587c8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:42.901794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5c2c91bd-781c-4a6c-bae0-279daec587c8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1213 microversion: 2.1 time: 0.438343 Apr 16 16:53:42.902762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 309/581] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:42 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1213 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:42.922665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-8d561709-ddf6-4e00-a9dc-020bfc27327b req-44652e58-835c-41e5-b88e-bfb4cd234bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6362be-f2e6-4f47-ae72-f6f8b12063dd", "name": "network-vif-deleted", "tag": "d1974541-0b41-4461-a761-f565ef4eb7b8"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:42.926631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:53:42.926631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:53:42.937024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-8d561709-ddf6-4e00-a9dc-020bfc27327b req-44652e58-835c-41e5-b88e-bfb4cd234bc7 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:42.937929 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-8d561709-ddf6-4e00-a9dc-020bfc27327b req-44652e58-835c-41e5-b88e-bfb4cd234bc7 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:42.960876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-8d561709-ddf6-4e00-a9dc-020bfc27327b req-44652e58-835c-41e5-b88e-bfb4cd234bc7 service nova] Creating event network-vif-deleted:d1974541-0b41-4461-a761-f565ef4eb7b8 for instance 9d6362be-f2e6-4f47-ae72-f6f8b12063dd on hv-cinder-73362 Apr 16 16:53:42.968366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-8d561709-ddf6-4e00-a9dc-020bfc27327b req-44652e58-835c-41e5-b88e-bfb4cd234bc7 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051228 Apr 16 16:53:42.975277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 310/582] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:53:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:43.095030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:43.106669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1dae1617-71ad-4bd7-8aaf-0b1ce7292566 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 200 len: 1312 microversion: 2.1 time: 0.493344 Apr 16 16:53:43.108056 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 273/583] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:42 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 1312 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:43.482993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0b2adbcd-db50-4f9b-80b9-2c9d0ecd34b0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:43.484216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0b2adbcd-db50-4f9b-80b9-2c9d0ecd34b0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:43.506808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b2adbcd-db50-4f9b-80b9-2c9d0ecd34b0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:43.507723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b2adbcd-db50-4f9b-80b9-2c9d0ecd34b0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:43.508863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b2adbcd-db50-4f9b-80b9-2c9d0ecd34b0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:43.509568 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b2adbcd-db50-4f9b-80b9-2c9d0ecd34b0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:43.631078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cc6ceff6-62a3-4517-b6f7-b526d666a4e6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:43.631749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cc6ceff6-62a3-4517-b6f7-b526d666a4e6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:43.665229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc6ceff6-62a3-4517-b6f7-b526d666a4e6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:43.670437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc6ceff6-62a3-4517-b6f7-b526d666a4e6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:43.683476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc6ceff6-62a3-4517-b6f7-b526d666a4e6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:43.684159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc6ceff6-62a3-4517-b6f7-b526d666a4e6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:44.361137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0b2adbcd-db50-4f9b-80b9-2c9d0ecd34b0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:44.372200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0b2adbcd-db50-4f9b-80b9-2c9d0ecd34b0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:44.373330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0b2adbcd-db50-4f9b-80b9-2c9d0ecd34b0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:44.374548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0b2adbcd-db50-4f9b-80b9-2c9d0ecd34b0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.897186 Apr 16 16:53:44.375979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 311/584] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:43 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:44.381137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-28d849c4-46de-46a2-8d49-fd1021f48a0f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:44.381813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-28d849c4-46de-46a2-8d49-fd1021f48a0f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:44.389908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28d849c4-46de-46a2-8d49-fd1021f48a0f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:44.390483 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28d849c4-46de-46a2-8d49-fd1021f48a0f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:44.392271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28d849c4-46de-46a2-8d49-fd1021f48a0f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:44.392882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-28d849c4-46de-46a2-8d49-fd1021f48a0f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:44.411875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cc6ceff6-62a3-4517-b6f7-b526d666a4e6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:44.424074 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cc6ceff6-62a3-4517-b6f7-b526d666a4e6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1567 microversion: 2.1 time: 0.799174 Apr 16 16:53:44.452796 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 274/585] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:43 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1567 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:44.475778 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-953ef426-8735-462c-9cea-311e2db7187b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:44.476741 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-953ef426-8735-462c-9cea-311e2db7187b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: 9d6362be-f2e6-4f47-ae72-f6f8b12063dd] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:44.485756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-953ef426-8735-462c-9cea-311e2db7187b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:44.489129 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-953ef426-8735-462c-9cea-311e2db7187b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:44.490246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-953ef426-8735-462c-9cea-311e2db7187b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:44.490914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-953ef426-8735-462c-9cea-311e2db7187b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:44.550377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-953ef426-8735-462c-9cea-311e2db7187b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] HTTP exception thrown: Instance 9d6362be-f2e6-4f47-ae72-f6f8b12063dd could not be found. Apr 16 16:53:44.551210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-953ef426-8735-462c-9cea-311e2db7187b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Returning 404 to user: Instance 9d6362be-f2e6-4f47-ae72-f6f8b12063dd could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:53:44.552261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-953ef426-8735-462c-9cea-311e2db7187b tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd" status: 404 len: 111 microversion: 2.1 time: 0.098051 Apr 16 16:53:44.553024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 275/586] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:44 2021] GET /compute/v2.1/servers/9d6362be-f2e6-4f47-ae72-f6f8b12063dd => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:53:44.578161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-28d849c4-46de-46a2-8d49-fd1021f48a0f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:44.579297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2a654feb-249e-40bf-aea1-52f8aed1f33f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:44.579873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2a654feb-249e-40bf-aea1-52f8aed1f33f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:44.587779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a654feb-249e-40bf-aea1-52f8aed1f33f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:44.588507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a654feb-249e-40bf-aea1-52f8aed1f33f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:44.589386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-28d849c4-46de-46a2-8d49-fd1021f48a0f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1201 microversion: 2.1 time: 0.212142 Apr 16 16:53:44.589700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a654feb-249e-40bf-aea1-52f8aed1f33f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:44.590016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 312/587] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:44 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1201 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:44.594418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a654feb-249e-40bf-aea1-52f8aed1f33f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:44.791802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-2a654feb-249e-40bf-aea1-52f8aed1f33f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lazy-loading 'services' on Instance uuid 139562a9-bb46-4937-898d-cf6179ddc48d {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:53:44.945222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2a654feb-249e-40bf-aea1-52f8aed1f33f tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "DELETE /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/os-volume_attachments/61303cb5-e35c-4f83-9d8a-b3c717e0ac6f" status: 202 len: 0 microversion: 2.1 time: 0.369896 Apr 16 16:53:44.945882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 276/588] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 16:53:44 2021] DELETE /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d/os-volume_attachments/61303cb5-e35c-4f83-9d8a-b3c717e0ac6f => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:53:45.402709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cbdb8df5-284e-4c0b-b68b-8122ddab910f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:45.403392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cbdb8df5-284e-4c0b-b68b-8122ddab910f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:45.414134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cbdb8df5-284e-4c0b-b68b-8122ddab910f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:45.415250 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cbdb8df5-284e-4c0b-b68b-8122ddab910f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:45.416378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cbdb8df5-284e-4c0b-b68b-8122ddab910f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:45.417354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cbdb8df5-284e-4c0b-b68b-8122ddab910f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:45.612071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8e94e556-e967-4654-91b9-bbbcd04547a1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:45.614228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8e94e556-e967-4654-91b9-bbbcd04547a1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:45.624959 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e94e556-e967-4654-91b9-bbbcd04547a1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:45.625993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e94e556-e967-4654-91b9-bbbcd04547a1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:45.627530 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e94e556-e967-4654-91b9-bbbcd04547a1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:45.628730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e94e556-e967-4654-91b9-bbbcd04547a1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:46.037248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cbdb8df5-284e-4c0b-b68b-8122ddab910f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:46.082441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cbdb8df5-284e-4c0b-b68b-8122ddab910f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:46.084518 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cbdb8df5-284e-4c0b-b68b-8122ddab910f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:46.086211 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cbdb8df5-284e-4c0b-b68b-8122ddab910f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.694085 Apr 16 16:53:46.100427 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 313/589] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:45 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:46.101133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3d9ca5cc-6dfa-442e-9177-b6897f3d5bb6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:46.101686 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3d9ca5cc-6dfa-442e-9177-b6897f3d5bb6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:46.115341 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d9ca5cc-6dfa-442e-9177-b6897f3d5bb6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:46.115863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d9ca5cc-6dfa-442e-9177-b6897f3d5bb6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:46.117202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d9ca5cc-6dfa-442e-9177-b6897f3d5bb6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:46.117724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d9ca5cc-6dfa-442e-9177-b6897f3d5bb6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:46.209213 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3d9ca5cc-6dfa-442e-9177-b6897f3d5bb6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:53:46.403828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3d9ca5cc-6dfa-442e-9177-b6897f3d5bb6 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "DELETE /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 204 len: 0 microversion: 2.1 time: 0.309573 Apr 16 16:53:46.404689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 314/590] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:53:46 2021] DELETE /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:53:46.415145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-faa84fe4-3942-42f4-b316-be242c847e2a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:46.416017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-faa84fe4-3942-42f4-b316-be242c847e2a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:46.440826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-faa84fe4-3942-42f4-b316-be242c847e2a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:46.441411 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-faa84fe4-3942-42f4-b316-be242c847e2a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:46.442708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-faa84fe4-3942-42f4-b316-be242c847e2a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:46.443030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-faa84fe4-3942-42f4-b316-be242c847e2a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:46.962049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8e94e556-e967-4654-91b9-bbbcd04547a1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:46.973286 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8e94e556-e967-4654-91b9-bbbcd04547a1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 1.368797 Apr 16 16:53:46.974450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 277/591] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:45 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:46.980171 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-9369068a-17f5-423d-bb47-3d7ebaf4c62d req-80120b9c-9580-4e5a-bd6b-78f405fc7c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf021fce-d230-4117-992c-f91cd978276c", "name": "network-vif-plugged", "status": "completed", "tag": "fd825542-a1af-4ba6-8c00-d64d5199c7e6"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:46.982466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:53:46.982466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:53:46.993263 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-9369068a-17f5-423d-bb47-3d7ebaf4c62d req-80120b9c-9580-4e5a-bd6b-78f405fc7c15 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:46.993886 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-9369068a-17f5-423d-bb47-3d7ebaf4c62d req-80120b9c-9580-4e5a-bd6b-78f405fc7c15 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:47.020764 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-9369068a-17f5-423d-bb47-3d7ebaf4c62d req-80120b9c-9580-4e5a-bd6b-78f405fc7c15 service nova] Creating event network-vif-plugged:fd825542-a1af-4ba6-8c00-d64d5199c7e6 for instance bf021fce-d230-4117-992c-f91cd978276c on hv-cinder-73362 Apr 16 16:53:47.028605 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-9369068a-17f5-423d-bb47-3d7ebaf4c62d req-80120b9c-9580-4e5a-bd6b-78f405fc7c15 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052668 Apr 16 16:53:47.030034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 278/592] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:53:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:47.109126 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-26ea0c30-9f04-49a6-8593-d19b63b8ab53 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:47.110043 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-26ea0c30-9f04-49a6-8593-d19b63b8ab53 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:47.118312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-26ea0c30-9f04-49a6-8593-d19b63b8ab53 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:47.118798 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-26ea0c30-9f04-49a6-8593-d19b63b8ab53 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:47.119910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-26ea0c30-9f04-49a6-8593-d19b63b8ab53 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:47.120382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-26ea0c30-9f04-49a6-8593-d19b63b8ab53 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:47.275735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-faa84fe4-3942-42f4-b316-be242c847e2a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:47.290908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-faa84fe4-3942-42f4-b316-be242c847e2a tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1516 microversion: 2.1 time: 0.880353 Apr 16 16:53:47.291880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 315/593] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:46 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1516 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:47.769704 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-26ea0c30-9f04-49a6-8593-d19b63b8ab53 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:47.782244 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-26ea0c30-9f04-49a6-8593-d19b63b8ab53 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:47.783945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-26ea0c30-9f04-49a6-8593-d19b63b8ab53 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:47.785456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-26ea0c30-9f04-49a6-8593-d19b63b8ab53 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.681037 Apr 16 16:53:47.798042 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 279/594] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:47 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:47.993042 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7b31f6e4-5355-4e6d-ba8d-090cbb10a11d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:47.993720 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7b31f6e4-5355-4e6d-ba8d-090cbb10a11d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:48.002369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b31f6e4-5355-4e6d-ba8d-090cbb10a11d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:48.002894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b31f6e4-5355-4e6d-ba8d-090cbb10a11d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:48.003734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b31f6e4-5355-4e6d-ba8d-090cbb10a11d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:48.004225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b31f6e4-5355-4e6d-ba8d-090cbb10a11d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:48.310331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-89784b15-1a56-40ee-8694-a8fd936c76f9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:48.311403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-89784b15-1a56-40ee-8694-a8fd936c76f9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:48.319790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89784b15-1a56-40ee-8694-a8fd936c76f9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:48.320299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89784b15-1a56-40ee-8694-a8fd936c76f9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:48.321142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89784b15-1a56-40ee-8694-a8fd936c76f9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:48.321633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89784b15-1a56-40ee-8694-a8fd936c76f9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:49.125177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7b31f6e4-5355-4e6d-ba8d-090cbb10a11d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:49.141756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7b31f6e4-5355-4e6d-ba8d-090cbb10a11d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 1.152924 Apr 16 16:53:49.145065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 316/595] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:47 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:49.162183 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-68ee8dbb-fdd8-47c6-a237-f5b42781bd5a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:49.182113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-68ee8dbb-fdd8-47c6-a237-f5b42781bd5a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:49.198438 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-68ee8dbb-fdd8-47c6-a237-f5b42781bd5a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:49.199207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-68ee8dbb-fdd8-47c6-a237-f5b42781bd5a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:49.200375 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-68ee8dbb-fdd8-47c6-a237-f5b42781bd5a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:49.201360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-68ee8dbb-fdd8-47c6-a237-f5b42781bd5a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:49.475162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-89784b15-1a56-40ee-8694-a8fd936c76f9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a48edfa5ca47949ffb787b0d7fe204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46c79620899432c8193a987ece333df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:49.490546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-89784b15-1a56-40ee-8694-a8fd936c76f9 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 200 len: 1516 microversion: 2.1 time: 1.184084 Apr 16 16:53:49.508730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 280/596] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:48 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 1516 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:49.517637 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ec0865ca-c5c9-4a78-b585-7ce4e8c4974b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:49.518190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ec0865ca-c5c9-4a78-b585-7ce4e8c4974b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:49.529168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ec0865ca-c5c9-4a78-b585-7ce4e8c4974b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:49.530125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ec0865ca-c5c9-4a78-b585-7ce4e8c4974b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:49.531279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ec0865ca-c5c9-4a78-b585-7ce4e8c4974b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:49.533611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ec0865ca-c5c9-4a78-b585-7ce4e8c4974b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:49.631133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ec0865ca-c5c9-4a78-b585-7ce4e8c4974b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Going to try to terminate instance {{(pid=99399) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:53:49.800118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ec0865ca-c5c9-4a78-b585-7ce4e8c4974b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "DELETE /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 204 len: 0 microversion: 2.1 time: 0.289605 Apr 16 16:53:49.801417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 281/597] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:53:49 2021] DELETE /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:53:49.812145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-eec4027c-72d5-4553-a80c-eee440a43d13 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:49.813798 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-eec4027c-72d5-4553-a80c-eee440a43d13 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:49.824995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eec4027c-72d5-4553-a80c-eee440a43d13 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:49.825736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eec4027c-72d5-4553-a80c-eee440a43d13 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:49.826796 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eec4027c-72d5-4553-a80c-eee440a43d13 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:49.827430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eec4027c-72d5-4553-a80c-eee440a43d13 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:49.840900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-68ee8dbb-fdd8-47c6-a237-f5b42781bd5a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:49.854934 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-68ee8dbb-fdd8-47c6-a237-f5b42781bd5a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:49.859017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-68ee8dbb-fdd8-47c6-a237-f5b42781bd5a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:49.875321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-68ee8dbb-fdd8-47c6-a237-f5b42781bd5a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1813 microversion: 2.20 time: 0.727189 Apr 16 16:53:49.876229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 317/598] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:49 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1813 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:49.893478 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-794685aa-26f8-4785-a751-1066c3b1462f req-0a0e0c3e-b42f-447d-a576-e2256e4b224c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1414be-e673-4c5e-b491-990d5eabe83f", "name": "network-vif-deleted", "tag": "baf1bfe7-da12-4d36-b1c7-35557ebac6d2"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:49.895591 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:53:49.895591 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:53:49.922759 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-794685aa-26f8-4785-a751-1066c3b1462f req-0a0e0c3e-b42f-447d-a576-e2256e4b224c service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:49.923592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-794685aa-26f8-4785-a751-1066c3b1462f req-0a0e0c3e-b42f-447d-a576-e2256e4b224c service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:49.942856 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-794685aa-26f8-4785-a751-1066c3b1462f req-0a0e0c3e-b42f-447d-a576-e2256e4b224c service nova] Creating event network-vif-deleted:baf1bfe7-da12-4d36-b1c7-35557ebac6d2 for instance ce1414be-e673-4c5e-b491-990d5eabe83f on hv-cinder-73362 Apr 16 16:53:49.951920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-794685aa-26f8-4785-a751-1066c3b1462f req-0a0e0c3e-b42f-447d-a576-e2256e4b224c service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063220 Apr 16 16:53:49.952597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 318/599] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:53:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:50.163908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3a5457c3-09e9-43b5-a1bc-44122ab318f7 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:50.165507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3a5457c3-09e9-43b5-a1bc-44122ab318f7 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:50.174561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a5457c3-09e9-43b5-a1bc-44122ab318f7 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:50.175440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a5457c3-09e9-43b5-a1bc-44122ab318f7 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:50.176654 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a5457c3-09e9-43b5-a1bc-44122ab318f7 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:50.177464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a5457c3-09e9-43b5-a1bc-44122ab318f7 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:50.624692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-eec4027c-72d5-4553-a80c-eee440a43d13 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:50.650780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-eec4027c-72d5-4553-a80c-eee440a43d13 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1511 microversion: 2.1 time: 0.844550 Apr 16 16:53:50.651419 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 282/600] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:49 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1511 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:50.667176 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-98ed14df-ced2-4c8f-be2c-69c8ddca4044 req-5328a43a-5b31-4434-af53-d8af503460ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954b9698-4e4c-4bd2-9cba-021819421e40", "tag": "c82bdbb9-8da8-4836-a28f-01855d319f56"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:50.669041 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:53:50.669041 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:53:50.679532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-98ed14df-ced2-4c8f-be2c-69c8ddca4044 req-5328a43a-5b31-4434-af53-d8af503460ac service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:50.680305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-98ed14df-ced2-4c8f-be2c-69c8ddca4044 req-5328a43a-5b31-4434-af53-d8af503460ac service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:50.702883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-98ed14df-ced2-4c8f-be2c-69c8ddca4044 req-5328a43a-5b31-4434-af53-d8af503460ac service nova] Creating event network-changed:c82bdbb9-8da8-4836-a28f-01855d319f56 for instance 954b9698-4e4c-4bd2-9cba-021819421e40 on hv-cinder-73362 Apr 16 16:53:50.709293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-98ed14df-ced2-4c8f-be2c-69c8ddca4044 req-5328a43a-5b31-4434-af53-d8af503460ac service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056021 Apr 16 16:53:50.710192 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 283/601] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:53:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:50.717062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-46650386-0234-43d8-b62e-e2f3cbfeacb7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:50.718059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-46650386-0234-43d8-b62e-e2f3cbfeacb7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] [instance: ce1414be-e673-4c5e-b491-990d5eabe83f] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:50.727128 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46650386-0234-43d8-b62e-e2f3cbfeacb7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:50.727868 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46650386-0234-43d8-b62e-e2f3cbfeacb7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:50.729030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46650386-0234-43d8-b62e-e2f3cbfeacb7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:50.729673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-46650386-0234-43d8-b62e-e2f3cbfeacb7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:50.790048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-46650386-0234-43d8-b62e-e2f3cbfeacb7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] HTTP exception thrown: Instance ce1414be-e673-4c5e-b491-990d5eabe83f could not be found. Apr 16 16:53:50.790979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-46650386-0234-43d8-b62e-e2f3cbfeacb7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] Returning 404 to user: Instance ce1414be-e673-4c5e-b491-990d5eabe83f could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:53:50.792045 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-46650386-0234-43d8-b62e-e2f3cbfeacb7 tempest-AttachVolumeNegativeTest-1570055156 tempest-AttachVolumeNegativeTest-1570055156-project] 10.222.0.103 "GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f" status: 404 len: 111 microversion: 2.1 time: 0.080534 Apr 16 16:53:50.792855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 284/602] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:50 2021] GET /compute/v2.1/servers/ce1414be-e673-4c5e-b491-990d5eabe83f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:53:50.888146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3a5457c3-09e9-43b5-a1bc-44122ab318f7 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:50.897628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-39755992-d512-4afa-832e-bb21ad0510b3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:50.900207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-39755992-d512-4afa-832e-bb21ad0510b3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:50.912738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3a5457c3-09e9-43b5-a1bc-44122ab318f7 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 0.752383 Apr 16 16:53:50.916458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-39755992-d512-4afa-832e-bb21ad0510b3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:50.917397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 319/603] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:50 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:50.918127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-39755992-d512-4afa-832e-bb21ad0510b3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:50.920156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-39755992-d512-4afa-832e-bb21ad0510b3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:50.920915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-39755992-d512-4afa-832e-bb21ad0510b3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:51.549611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-39755992-d512-4afa-832e-bb21ad0510b3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:51.564177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-39755992-d512-4afa-832e-bb21ad0510b3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:51.565950 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-39755992-d512-4afa-832e-bb21ad0510b3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:51.580184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-39755992-d512-4afa-832e-bb21ad0510b3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1800 microversion: 2.20 time: 0.689003 Apr 16 16:53:51.581137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 285/604] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:53:50 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1800 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:53:51.671691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-50fb8784-a5b3-4c26-97c8-d21ae9c6a7c6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:51.672734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-50fb8784-a5b3-4c26-97c8-d21ae9c6a7c6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:51.682938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-50fb8784-a5b3-4c26-97c8-d21ae9c6a7c6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:51.683786 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-50fb8784-a5b3-4c26-97c8-d21ae9c6a7c6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:51.690492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-50fb8784-a5b3-4c26-97c8-d21ae9c6a7c6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:51.691577 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-50fb8784-a5b3-4c26-97c8-d21ae9c6a7c6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:51.935550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7c1fab85-ceb0-4867-9173-f85b8a150bbf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:51.936659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7c1fab85-ceb0-4867-9173-f85b8a150bbf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:51.950329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7c1fab85-ceb0-4867-9173-f85b8a150bbf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:51.959366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7c1fab85-ceb0-4867-9173-f85b8a150bbf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:51.960343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7c1fab85-ceb0-4867-9173-f85b8a150bbf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:51.960848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7c1fab85-ceb0-4867-9173-f85b8a150bbf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:52.980863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-50fb8784-a5b3-4c26-97c8-d21ae9c6a7c6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:52.996902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-50fb8784-a5b3-4c26-97c8-d21ae9c6a7c6 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1511 microversion: 2.1 time: 1.329798 Apr 16 16:53:52.997873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 320/605] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:51 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1511 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:53.374459 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7c1fab85-ceb0-4867-9173-f85b8a150bbf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:53.400785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7c1fab85-ceb0-4867-9173-f85b8a150bbf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 1.469185 Apr 16 16:53:53.401434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 286/606] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:51 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:54.017219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-21c335b8-3601-4311-bae7-211eac7a132b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:54.017872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-21c335b8-3601-4311-bae7-211eac7a132b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:54.043998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21c335b8-3601-4311-bae7-211eac7a132b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:54.048281 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21c335b8-3601-4311-bae7-211eac7a132b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:54.049795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21c335b8-3601-4311-bae7-211eac7a132b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:54.057920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21c335b8-3601-4311-bae7-211eac7a132b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:54.420327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-90832eaa-0620-4fd7-9bdc-8c1f30fac0dc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:54.421632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-90832eaa-0620-4fd7-9bdc-8c1f30fac0dc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:54.431890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90832eaa-0620-4fd7-9bdc-8c1f30fac0dc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:54.432740 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90832eaa-0620-4fd7-9bdc-8c1f30fac0dc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:54.433806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90832eaa-0620-4fd7-9bdc-8c1f30fac0dc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:54.434542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-90832eaa-0620-4fd7-9bdc-8c1f30fac0dc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:55.176678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-21c335b8-3601-4311-bae7-211eac7a132b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:55.192591 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-21c335b8-3601-4311-bae7-211eac7a132b tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 200 len: 1511 microversion: 2.1 time: 1.179890 Apr 16 16:53:55.193249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 321/607] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:54 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 1511 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:55.215634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-11b71a7c-bc50-42df-b3cc-d24e764b142f req-6dc4a1ff-bfb8-42ca-87f0-66a745c40a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59b60bc4-7bd4-4920-9a97-ac9d637dcbdc", "name": "network-vif-deleted", "tag": "3ed1e123-5d85-4b45-a4c3-3b49fe2aeae9"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:55.217389 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:53:55.217389 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:53:55.247051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-11b71a7c-bc50-42df-b3cc-d24e764b142f req-6dc4a1ff-bfb8-42ca-87f0-66a745c40a48 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:55.247577 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-11b71a7c-bc50-42df-b3cc-d24e764b142f req-6dc4a1ff-bfb8-42ca-87f0-66a745c40a48 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:55.281004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-11b71a7c-bc50-42df-b3cc-d24e764b142f req-6dc4a1ff-bfb8-42ca-87f0-66a745c40a48 service nova] Creating event network-vif-deleted:3ed1e123-5d85-4b45-a4c3-3b49fe2aeae9 for instance 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc on hv-cinder-73362 Apr 16 16:53:55.288493 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-11b71a7c-bc50-42df-b3cc-d24e764b142f req-6dc4a1ff-bfb8-42ca-87f0-66a745c40a48 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076916 Apr 16 16:53:55.289744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 322/608] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:53:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:55.351280 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-90832eaa-0620-4fd7-9bdc-8c1f30fac0dc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:55.380126 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-90832eaa-0620-4fd7-9bdc-8c1f30fac0dc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 0.964345 Apr 16 16:53:55.384680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 287/609] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:54 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:56.221581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8e3b3388-1c6f-48d4-b823-cfe7974a4a3a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:56.223211 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8e3b3388-1c6f-48d4-b823-cfe7974a4a3a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:56.232502 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e3b3388-1c6f-48d4-b823-cfe7974a4a3a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:56.233093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e3b3388-1c6f-48d4-b823-cfe7974a4a3a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:56.233647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e3b3388-1c6f-48d4-b823-cfe7974a4a3a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:56.234206 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e3b3388-1c6f-48d4-b823-cfe7974a4a3a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:56.291461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-8e3b3388-1c6f-48d4-b823-cfe7974a4a3a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] HTTP exception thrown: Instance 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc could not be found. Apr 16 16:53:56.292094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8e3b3388-1c6f-48d4-b823-cfe7974a4a3a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Returning 404 to user: Instance 59b60bc4-7bd4-4920-9a97-ac9d637dcbdc could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:53:56.292998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8e3b3388-1c6f-48d4-b823-cfe7974a4a3a tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc" status: 404 len: 111 microversion: 2.1 time: 0.080759 Apr 16 16:53:56.293808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 323/610] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:56 2021] GET /compute/v2.1/servers/59b60bc4-7bd4-4920-9a97-ac9d637dcbdc => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:53:56.303433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-17418d31-cf1e-415b-8df5-6e51c37ea8da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:56.303983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-17418d31-cf1e-415b-8df5-6e51c37ea8da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:56.312149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17418d31-cf1e-415b-8df5-6e51c37ea8da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:56.313220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17418d31-cf1e-415b-8df5-6e51c37ea8da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:56.314130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17418d31-cf1e-415b-8df5-6e51c37ea8da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:56.314650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17418d31-cf1e-415b-8df5-6e51c37ea8da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:56.387104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-17418d31-cf1e-415b-8df5-6e51c37ea8da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Going to try to terminate instance {{(pid=99399) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:53:56.402586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b87d8da6-080c-41c2-a025-430bf551e4bf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:56.403494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b87d8da6-080c-41c2-a025-430bf551e4bf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:56.414756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b87d8da6-080c-41c2-a025-430bf551e4bf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:56.415350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b87d8da6-080c-41c2-a025-430bf551e4bf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:56.416281 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b87d8da6-080c-41c2-a025-430bf551e4bf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:56.416957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b87d8da6-080c-41c2-a025-430bf551e4bf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:56.536873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-17418d31-cf1e-415b-8df5-6e51c37ea8da tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "DELETE /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 204 len: 0 microversion: 2.1 time: 0.236624 Apr 16 16:53:56.537685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 288/611] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:53:56 2021] DELETE /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:53:56.552458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a4ff3305-a099-4c5f-917c-a1e18615cf07 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:56.554040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a4ff3305-a099-4c5f-917c-a1e18615cf07 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:56.565855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4ff3305-a099-4c5f-917c-a1e18615cf07 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:56.566663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4ff3305-a099-4c5f-917c-a1e18615cf07 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:56.567815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4ff3305-a099-4c5f-917c-a1e18615cf07 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:56.568649 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4ff3305-a099-4c5f-917c-a1e18615cf07 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:56.814599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b87d8da6-080c-41c2-a025-430bf551e4bf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:56.824321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b87d8da6-080c-41c2-a025-430bf551e4bf tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 0.426370 Apr 16 16:53:56.834815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 324/612] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:56 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:56.935531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a4ff3305-a099-4c5f-917c-a1e18615cf07 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:56.948107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a4ff3305-a099-4c5f-917c-a1e18615cf07 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.405214 Apr 16 16:53:56.948936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 289/613] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:56 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:57.001837 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c0e401ac-9d9e-4e8b-9064-2d0db904e454 tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] Action: 'create', calling method: .version_select at 0x7f0d448b99d8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-112430463", "metadata": {"Type": "work"}}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:53:57.552255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c0e401ac-9d9e-4e8b-9064-2d0db904e454 tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] 10.222.0.103 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.715898 Apr 16 16:53:57.553453 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 325/614] 10.222.0.103 () {60 vars in 1151 bytes} [Fri Apr 16 16:53:56 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 718 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Apr 16 16:53:57.565197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-57451ab2-309d-46d0-a123-5ece1208d616 tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] Calling method '.version_select at 0x7f0d469bdc80>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:57.692629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-57451ab2-309d-46d0-a123-5ece1208d616 tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1" status: 200 len: 352 microversion: 2.1 time: 0.131388 Apr 16 16:53:57.698541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 290/615] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:53:57 2021] GET /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1 => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:57.851901 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-03983b1b-6ddf-4e7e-8f42-f9d2bb5c5c0a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:57.853186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-03983b1b-6ddf-4e7e-8f42-f9d2bb5c5c0a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:57.865941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03983b1b-6ddf-4e7e-8f42-f9d2bb5c5c0a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:57.867183 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03983b1b-6ddf-4e7e-8f42-f9d2bb5c5c0a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:57.868280 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03983b1b-6ddf-4e7e-8f42-f9d2bb5c5c0a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:57.868986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03983b1b-6ddf-4e7e-8f42-f9d2bb5c5c0a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:57.974495 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ed6b3c48-3918-4ccc-b6f6-80a8db7fad02 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:57.975174 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ed6b3c48-3918-4ccc-b6f6-80a8db7fad02 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:57.983847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed6b3c48-3918-4ccc-b6f6-80a8db7fad02 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:57.985077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed6b3c48-3918-4ccc-b6f6-80a8db7fad02 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:57.986382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed6b3c48-3918-4ccc-b6f6-80a8db7fad02 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:57.987267 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed6b3c48-3918-4ccc-b6f6-80a8db7fad02 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:58.221426 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-03983b1b-6ddf-4e7e-8f42-f9d2bb5c5c0a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:58.233184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-03983b1b-6ddf-4e7e-8f42-f9d2bb5c5c0a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 0.388407 Apr 16 16:53:58.234024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 326/616] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:57 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:58.311429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ed6b3c48-3918-4ccc-b6f6-80a8db7fad02 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:58.322892 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ed6b3c48-3918-4ccc-b6f6-80a8db7fad02 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.358686 Apr 16 16:53:58.324469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 291/617] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:57 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:53:58.710888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e4eff4e2-39ec-42ea-aa34-4283532c349c tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] Calling method '.version_select at 0x7f0d444f0268>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:58.888571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e4eff4e2-39ec-42ea-aa34-4283532c349c tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1" status: 200 len: 353 microversion: 2.1 time: 0.185611 Apr 16 16:53:58.889663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 327/618] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:53:58 2021] GET /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1 => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:58.911666 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-75d6d6f4-061e-4948-a9b4-9d70d51413ac tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] Calling method '.version_select at 0x7f0d450c8d90>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:59.060453 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-75d6d6f4-061e-4948-a9b4-9d70d51413ac tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1" status: 200 len: 353 microversion: 2.1 time: 0.157230 Apr 16 16:53:59.067939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 292/619] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:53:58 2021] GET /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1 => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:59.083083 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5be4f7cd-c503-4bf5-b8d3-9e3aa98bd40d tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] Calling method '.version_select at 0x7f0d448b9b70>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:59.211079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5be4f7cd-c503-4bf5-b8d3-9e3aa98bd40d tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] 10.222.0.103 "DELETE /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1" status: 202 len: 0 microversion: 2.1 time: 0.132423 Apr 16 16:53:59.212324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 328/620] 10.222.0.103 () {58 vars in 1243 bytes} [Fri Apr 16 16:53:59 2021] DELETE /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:53:59.222939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-82a5a3de-0502-450d-bf52-cfa5e8658af4 tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] Calling method '.version_select at 0x7f0d44673378>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:59.258208 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1c411272-322b-4d4c-9513-18863eea47a9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:59.259735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1c411272-322b-4d4c-9513-18863eea47a9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:59.280262 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c411272-322b-4d4c-9513-18863eea47a9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:59.280798 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c411272-322b-4d4c-9513-18863eea47a9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:59.282144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c411272-322b-4d4c-9513-18863eea47a9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:59.282816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c411272-322b-4d4c-9513-18863eea47a9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:59.415759 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-82a5a3de-0502-450d-bf52-cfa5e8658af4 tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1" status: 200 len: 352 microversion: 2.1 time: 0.198119 Apr 16 16:53:59.420959 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 293/621] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:53:59 2021] GET /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1 => generated 352 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:53:59.421446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-af8742b1-f3fd-4b48-9f4a-1a2d1fd61095 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:53:59.421971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-af8742b1-f3fd-4b48-9f4a-1a2d1fd61095 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:53:59.435009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af8742b1-f3fd-4b48-9f4a-1a2d1fd61095 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:59.435518 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af8742b1-f3fd-4b48-9f4a-1a2d1fd61095 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:59.436375 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af8742b1-f3fd-4b48-9f4a-1a2d1fd61095 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:53:59.436877 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-af8742b1-f3fd-4b48-9f4a-1a2d1fd61095 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:53:59.655981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1c411272-322b-4d4c-9513-18863eea47a9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:59.676179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1c411272-322b-4d4c-9513-18863eea47a9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 0.423518 Apr 16 16:53:59.677429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 329/622] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:59 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:53:59.771034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-af8742b1-f3fd-4b48-9f4a-1a2d1fd61095 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:53:59.781697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-af8742b1-f3fd-4b48-9f4a-1a2d1fd61095 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.363616 Apr 16 16:53:59.782827 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 294/623] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:53:59 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:00.017511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-67313a1f-c99b-4a7f-8d35-d0be917fc4f2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:00.023188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-67313a1f-c99b-4a7f-8d35-d0be917fc4f2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:00.058847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-67313a1f-c99b-4a7f-8d35-d0be917fc4f2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:00.074201 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-67313a1f-c99b-4a7f-8d35-d0be917fc4f2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:00.074201 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-67313a1f-c99b-4a7f-8d35-d0be917fc4f2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:00.074201 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-67313a1f-c99b-4a7f-8d35-d0be917fc4f2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:00.348258 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-67313a1f-c99b-4a7f-8d35-d0be917fc4f2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lazy-loading 'services' on Instance uuid 22e97f89-9724-46b1-8d71-56732a4b3c27 {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:54:00.429048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2723e038-5bbd-430e-bcc5-b25661cd8819 tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] Calling method '.version_select at 0x7f0d450c86a8>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:00.596119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-2723e038-5bbd-430e-bcc5-b25661cd8819 tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] HTTP exception thrown: Volume 92266200-dcbb-4cca-80b9-bfc345b4b4a1 could not be found. Apr 16 16:54:00.596963 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2723e038-5bbd-430e-bcc5-b25661cd8819 tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] Returning 404 to user: Volume 92266200-dcbb-4cca-80b9-bfc345b4b4a1 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:54:00.605303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2723e038-5bbd-430e-bcc5-b25661cd8819 tempest-VolumesGetTestJSON-1293307446 tempest-VolumesGetTestJSON-1293307446-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1" status: 404 len: 109 microversion: 2.1 time: 0.180456 Apr 16 16:54:00.606255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 295/624] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:54:00 2021] GET /compute/v2.1/os-volumes/92266200-dcbb-4cca-80b9-bfc345b4b4a1 => generated 109 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:54:00.607949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-67313a1f-c99b-4a7f-8d35-d0be917fc4f2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "DELETE /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/os-volume_attachments/4f30bf2b-a970-40fb-9028-49e69ac57bfe" status: 202 len: 0 microversion: 2.1 time: 0.601924 Apr 16 16:54:00.608947 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 330/625] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 16:54:00 2021] DELETE /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/os-volume_attachments/4f30bf2b-a970-40fb-9028-49e69ac57bfe => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:54:00.700628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2503a5ee-afbe-4964-9b0d-7e4d60a29b24 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:00.701767 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2503a5ee-afbe-4964-9b0d-7e4d60a29b24 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:00.721859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2503a5ee-afbe-4964-9b0d-7e4d60a29b24 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:00.723493 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2503a5ee-afbe-4964-9b0d-7e4d60a29b24 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:00.724943 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2503a5ee-afbe-4964-9b0d-7e4d60a29b24 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:00.725621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2503a5ee-afbe-4964-9b0d-7e4d60a29b24 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:00.811723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bee352e3-2b0d-4f5e-8d02-96f13874b468 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:00.816249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bee352e3-2b0d-4f5e-8d02-96f13874b468 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:00.856212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bee352e3-2b0d-4f5e-8d02-96f13874b468 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:00.858431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bee352e3-2b0d-4f5e-8d02-96f13874b468 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:00.858918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bee352e3-2b0d-4f5e-8d02-96f13874b468 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:00.859494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bee352e3-2b0d-4f5e-8d02-96f13874b468 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:01.295338 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2503a5ee-afbe-4964-9b0d-7e4d60a29b24 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:01.335089 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2503a5ee-afbe-4964-9b0d-7e4d60a29b24 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 0.641379 Apr 16 16:54:01.343671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 296/626] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:00 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:01.397605 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bee352e3-2b0d-4f5e-8d02-96f13874b468 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:01.425546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bee352e3-2b0d-4f5e-8d02-96f13874b468 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.627583 Apr 16 16:54:01.426480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 331/627] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:00 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:02.007917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dbd47627-312c-4364-aa9a-eb692fd6cce0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:02.022350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dbd47627-312c-4364-aa9a-eb692fd6cce0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:02.026123 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dbd47627-312c-4364-aa9a-eb692fd6cce0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:02.155013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dbd47627-312c-4364-aa9a-eb692fd6cce0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Going to try to stop instance {{(pid=99399) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 16 16:54:02.273484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dbd47627-312c-4364-aa9a-eb692fd6cce0 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 202 len: 0 microversion: 2.1 time: 0.269595 Apr 16 16:54:02.274717 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 297/628] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:54:02 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:54:02.296114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d5e81b44-9239-4177-a21d-9ec960111d29 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:02.300306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d5e81b44-9239-4177-a21d-9ec960111d29 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:02.321690 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5e81b44-9239-4177-a21d-9ec960111d29 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:02.322467 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5e81b44-9239-4177-a21d-9ec960111d29 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:02.324133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5e81b44-9239-4177-a21d-9ec960111d29 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:02.324966 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5e81b44-9239-4177-a21d-9ec960111d29 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:02.356266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-17a768ed-d2af-48dc-85f7-e4108247939f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:02.357058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-17a768ed-d2af-48dc-85f7-e4108247939f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:02.371118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17a768ed-d2af-48dc-85f7-e4108247939f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:02.371502 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17a768ed-d2af-48dc-85f7-e4108247939f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:02.372371 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17a768ed-d2af-48dc-85f7-e4108247939f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:02.372861 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17a768ed-d2af-48dc-85f7-e4108247939f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:03.261580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d5e81b44-9239-4177-a21d-9ec960111d29 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:03.274814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d5e81b44-9239-4177-a21d-9ec960111d29 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1682 microversion: 2.1 time: 0.995366 Apr 16 16:54:03.275476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 332/629] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:02 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1682 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:03.282017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-931749f4-dada-4c38-b7c1-815aa26c0285 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:03.282265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-17a768ed-d2af-48dc-85f7-e4108247939f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:03.282923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-931749f4-dada-4c38-b7c1-815aa26c0285 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:03.293161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-931749f4-dada-4c38-b7c1-815aa26c0285 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:03.293730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-931749f4-dada-4c38-b7c1-815aa26c0285 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:03.294614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-931749f4-dada-4c38-b7c1-815aa26c0285 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:03.295429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-931749f4-dada-4c38-b7c1-815aa26c0285 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:03.310818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-17a768ed-d2af-48dc-85f7-e4108247939f tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 0.958998 Apr 16 16:54:03.311450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 298/630] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:02 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:03.630109 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-931749f4-dada-4c38-b7c1-815aa26c0285 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:03.640773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-931749f4-dada-4c38-b7c1-815aa26c0285 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1527 microversion: 2.1 time: 0.363890 Apr 16 16:54:03.651778 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 333/631] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:03 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1527 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:04.049417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-00e9b9c1-2b21-4b87-b05c-97f22929f15a tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Action: 'create', calling method: .version_select at 0x7f0d450ee1e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1595167525"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:04.112833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-00e9b9c1-2b21-4b87-b05c-97f22929f15a tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Getting quotas for project 0944f6a6bc094a1db167f95dea7b6570. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:54:04.117470 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-00e9b9c1-2b21-4b87-b05c-97f22929f15a tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Getting quotas for user 2e8fdc3332504f689fb00135845b2ad4 and project 0944f6a6bc094a1db167f95dea7b6570. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:54:04.254360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-00e9b9c1-2b21-4b87-b05c-97f22929f15a tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Getting quotas for project 0944f6a6bc094a1db167f95dea7b6570. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:54:04.259724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-00e9b9c1-2b21-4b87-b05c-97f22929f15a tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Getting quotas for user 2e8fdc3332504f689fb00135845b2ad4 and project 0944f6a6bc094a1db167f95dea7b6570. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:54:04.275567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-00e9b9c1-2b21-4b87-b05c-97f22929f15a tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.231186 Apr 16 16:54:04.276852 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 299/632] 10.222.0.103 () {60 vars in 1153 bytes} [Fri Apr 16 16:54:04 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:04.308760 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c1bed239-30d8-4966-9da3-67c8ed8ac1da tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:04.310761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c1bed239-30d8-4966-9da3-67c8ed8ac1da tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:04.331912 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1bed239-30d8-4966-9da3-67c8ed8ac1da tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:04.333114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1bed239-30d8-4966-9da3-67c8ed8ac1da tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:04.334375 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1bed239-30d8-4966-9da3-67c8ed8ac1da tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:04.336167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1bed239-30d8-4966-9da3-67c8ed8ac1da tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:04.336596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-911b6f90-c01c-4c25-a824-09c2b5bfa99c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:04.337599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-911b6f90-c01c-4c25-a824-09c2b5bfa99c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:04.359000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-911b6f90-c01c-4c25-a824-09c2b5bfa99c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:04.360150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-911b6f90-c01c-4c25-a824-09c2b5bfa99c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:04.368017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-911b6f90-c01c-4c25-a824-09c2b5bfa99c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:04.368529 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-911b6f90-c01c-4c25-a824-09c2b5bfa99c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:05.053387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-911b6f90-c01c-4c25-a824-09c2b5bfa99c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:05.073179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-911b6f90-c01c-4c25-a824-09c2b5bfa99c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 0.744203 Apr 16 16:54:05.075224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 300/633] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:04 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:05.079380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c1bed239-30d8-4966-9da3-67c8ed8ac1da tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:05.093085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c1bed239-30d8-4966-9da3-67c8ed8ac1da tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1682 microversion: 2.1 time: 0.788937 Apr 16 16:54:05.093908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 334/634] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:04 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1682 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:05.094507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-89e740df-73e4-495e-a281-232205915e6e req-d7ddd866-0d44-4637-88a1-76db263a033d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954b9698-4e4c-4bd2-9cba-021819421e40", "name": "network-vif-plugged", "status": "completed", "tag": "c82bdbb9-8da8-4836-a28f-01855d319f56"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:05.098959 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-22708002", "imageRef": "744ebc88-7342-4998-9139-531b710a5b48", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1595167525", "networks": [{"uuid": "8c55fbc3-094c-44bb-b10a-f991a66d271b"}]}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:05.099391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:54:05.099391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:54:05.118078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-89e740df-73e4-495e-a281-232205915e6e req-d7ddd866-0d44-4637-88a1-76db263a033d service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:05.119269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-89e740df-73e4-495e-a281-232205915e6e req-d7ddd866-0d44-4637-88a1-76db263a033d service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:05.163800 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-89e740df-73e4-495e-a281-232205915e6e req-d7ddd866-0d44-4637-88a1-76db263a033d service nova] Creating event network-vif-plugged:c82bdbb9-8da8-4836-a28f-01855d319f56 for instance 954b9698-4e4c-4bd2-9cba-021819421e40 on hv-cinder-73362 Apr 16 16:54:05.174729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-89e740df-73e4-495e-a281-232205915e6e req-d7ddd866-0d44-4637-88a1-76db263a033d service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097048 Apr 16 16:54:05.176273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 301/635] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:54:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:54:05.194976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3fca44ed-0139-4c4a-a40c-1f3ae745cec3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:05.211435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3fca44ed-0139-4c4a-a40c-1f3ae745cec3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:05.239140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3fca44ed-0139-4c4a-a40c-1f3ae745cec3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:05.239994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3fca44ed-0139-4c4a-a40c-1f3ae745cec3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:05.248666 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3fca44ed-0139-4c4a-a40c-1f3ae745cec3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:05.250184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3fca44ed-0139-4c4a-a40c-1f3ae745cec3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:05.304066 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] validate_networks() for [('8c55fbc3-094c-44bb-b10a-f991a66d271b', None, None, None)] {{(pid=99398) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:54:05.664488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3fca44ed-0139-4c4a-a40c-1f3ae745cec3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfd10c1162d24f85acdbe3fe3d55a36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1487baf5ab430cb361532e11cd888c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:05.675039 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3fca44ed-0139-4c4a-a40c-1f3ae745cec3 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 200 len: 1485 microversion: 2.1 time: 0.490904 Apr 16 16:54:05.675872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 302/636] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:05 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 1485 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:05.685184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-2a3b608c-cb17-45bd-ac66-7f3b25bcf008 req-311c27d6-2479-4699-8777-01789ae15e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "139562a9-bb46-4937-898d-cf6179ddc48d", "name": "network-vif-deleted", "tag": "225036d6-cc14-48bb-962c-c75655bf76af"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:05.689250 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:54:05.689250 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:54:05.704380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-2a3b608c-cb17-45bd-ac66-7f3b25bcf008 req-311c27d6-2479-4699-8777-01789ae15e1b service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:05.705063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-2a3b608c-cb17-45bd-ac66-7f3b25bcf008 req-311c27d6-2479-4699-8777-01789ae15e1b service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:05.732012 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-2a3b608c-cb17-45bd-ac66-7f3b25bcf008 req-311c27d6-2479-4699-8777-01789ae15e1b service nova] Creating event network-vif-deleted:225036d6-cc14-48bb-962c-c75655bf76af for instance 139562a9-bb46-4937-898d-cf6179ddc48d on hv-cinder-73362 Apr 16 16:54:05.739654 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-2a3b608c-cb17-45bd-ac66-7f3b25bcf008 req-311c27d6-2479-4699-8777-01789ae15e1b service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061434 Apr 16 16:54:05.740954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 303/637] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:54:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:54:06.108260 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c3fe6905-f841-4056-868e-005f16d27be0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:06.109425 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c3fe6905-f841-4056-868e-005f16d27be0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:06.118488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c3fe6905-f841-4056-868e-005f16d27be0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:06.118858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c3fe6905-f841-4056-868e-005f16d27be0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:06.119726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c3fe6905-f841-4056-868e-005f16d27be0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:06.120230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c3fe6905-f841-4056-868e-005f16d27be0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:06.627831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Flavor limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:54:06.628731 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Image limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:54:06.629733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Flavor pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:54:06.630270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Image pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:54:06.630854 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:54:06.636814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c3fe6905-f841-4056-868e-005f16d27be0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:06.642182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:06.643192 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:06.644239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:06.644898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:06.654156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c3fe6905-f841-4056-868e-005f16d27be0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1268 microversion: 2.1 time: 0.555590 Apr 16 16:54:06.663953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 304/638] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:06 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1268 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:54:06.673936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ed188fc0-7071-4a11-afb8-f196ec64d5e9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:06.675044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Getting quotas for project 0944f6a6bc094a1db167f95dea7b6570. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:54:06.675316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ed188fc0-7071-4a11-afb8-f196ec64d5e9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:06.690783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed188fc0-7071-4a11-afb8-f196ec64d5e9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:06.691288 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed188fc0-7071-4a11-afb8-f196ec64d5e9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:06.692161 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed188fc0-7071-4a11-afb8-f196ec64d5e9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:06.692626 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed188fc0-7071-4a11-afb8-f196ec64d5e9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:06.695222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Getting quotas for user 2e8fdc3332504f689fb00135845b2ad4 and project 0944f6a6bc094a1db167f95dea7b6570. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:54:06.729997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Going to run 1 instances... {{(pid=99398) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:54:06.736266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='744ebc88-7342-4998-9139-531b710a5b48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:54:06.798175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0c410b2a-4b03-4ee5-a838-cd99db30ff7e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.701918 Apr 16 16:54:06.806402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 335/639] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:54:05 2021] POST /compute/v2.1/servers => generated 382 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:54:06.808031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-332352e2-4efc-4100-9183-44a3d2b4d2e9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:06.808706 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-332352e2-4efc-4100-9183-44a3d2b4d2e9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] [instance: 139562a9-bb46-4937-898d-cf6179ddc48d] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:06.829596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-332352e2-4efc-4100-9183-44a3d2b4d2e9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:06.830111 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-332352e2-4efc-4100-9183-44a3d2b4d2e9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:06.831034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-332352e2-4efc-4100-9183-44a3d2b4d2e9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:06.831532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-332352e2-4efc-4100-9183-44a3d2b4d2e9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:06.909128 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-332352e2-4efc-4100-9183-44a3d2b4d2e9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] HTTP exception thrown: Instance 139562a9-bb46-4937-898d-cf6179ddc48d could not be found. Apr 16 16:54:06.910003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-332352e2-4efc-4100-9183-44a3d2b4d2e9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] Returning 404 to user: Instance 139562a9-bb46-4937-898d-cf6179ddc48d could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:54:06.911122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-332352e2-4efc-4100-9183-44a3d2b4d2e9 tempest-ServerRescueNegativeTestJSON-1909319460 tempest-ServerRescueNegativeTestJSON-1909319460-project] 10.222.0.103 "GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d" status: 404 len: 111 microversion: 2.1 time: 0.111199 Apr 16 16:54:06.911948 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 336/640] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:06 2021] GET /compute/v2.1/servers/139562a9-bb46-4937-898d-cf6179ddc48d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:54:06.917044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-55df764f-38b0-4357-9ec9-43ed953d4c43 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:06.918023 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-55df764f-38b0-4357-9ec9-43ed953d4c43 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:07.098596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-55df764f-38b0-4357-9ec9-43ed953d4c43 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:07.108751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-55df764f-38b0-4357-9ec9-43ed953d4c43 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1261 microversion: 2.1 time: 0.195352 Apr 16 16:54:07.114902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 337/641] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:06 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:07.122611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ed188fc0-7071-4a11-afb8-f196ec64d5e9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:07.134621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ed188fc0-7071-4a11-afb8-f196ec64d5e9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1682 microversion: 2.1 time: 0.469035 Apr 16 16:54:07.136202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 305/642] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:06 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1682 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:07.676773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b9cae72e-0b32-4d51-ad94-842dc32a03fe tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:07.677462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b9cae72e-0b32-4d51-ad94-842dc32a03fe tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:07.686228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9cae72e-0b32-4d51-ad94-842dc32a03fe tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:07.687081 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9cae72e-0b32-4d51-ad94-842dc32a03fe tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:07.689711 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9cae72e-0b32-4d51-ad94-842dc32a03fe tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:07.690852 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9cae72e-0b32-4d51-ad94-842dc32a03fe tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:08.088145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b9cae72e-0b32-4d51-ad94-842dc32a03fe tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:08.098688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b9cae72e-0b32-4d51-ad94-842dc32a03fe tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1455 microversion: 2.1 time: 0.426450 Apr 16 16:54:08.100045 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 338/643] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:07 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1455 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:08.118387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8b650bc0-055f-4c38-a400-f377740f40b0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:08.119301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8b650bc0-055f-4c38-a400-f377740f40b0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:08.129661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b650bc0-055f-4c38-a400-f377740f40b0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:08.130642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b650bc0-055f-4c38-a400-f377740f40b0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:08.131640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b650bc0-055f-4c38-a400-f377740f40b0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:08.132285 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b650bc0-055f-4c38-a400-f377740f40b0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:08.145087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-797352d9-874c-4f18-9eaa-11b2bc23d48b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:08.146001 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-797352d9-874c-4f18-9eaa-11b2bc23d48b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:08.163430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-797352d9-874c-4f18-9eaa-11b2bc23d48b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:08.167393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-797352d9-874c-4f18-9eaa-11b2bc23d48b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:08.168508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-797352d9-874c-4f18-9eaa-11b2bc23d48b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:08.169611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-797352d9-874c-4f18-9eaa-11b2bc23d48b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:08.399873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-797352d9-874c-4f18-9eaa-11b2bc23d48b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:08.414777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-797352d9-874c-4f18-9eaa-11b2bc23d48b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1313 microversion: 2.1 time: 0.275303 Apr 16 16:54:08.415585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 339/644] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:08 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:54:08.440522 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e6effb54-da15-43c7-b1c7-eff04ec09dd2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:08.441056 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e6effb54-da15-43c7-b1c7-eff04ec09dd2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:08.460073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e6effb54-da15-43c7-b1c7-eff04ec09dd2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:08.460588 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e6effb54-da15-43c7-b1c7-eff04ec09dd2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:08.461480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e6effb54-da15-43c7-b1c7-eff04ec09dd2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:08.461979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e6effb54-da15-43c7-b1c7-eff04ec09dd2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:09.176506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8b650bc0-055f-4c38-a400-f377740f40b0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:09.191969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8b650bc0-055f-4c38-a400-f377740f40b0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1455 microversion: 2.1 time: 1.078186 Apr 16 16:54:09.211354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 306/645] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:08 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1455 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:09.347513 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e6effb54-da15-43c7-b1c7-eff04ec09dd2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:09.364981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e6effb54-da15-43c7-b1c7-eff04ec09dd2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1682 microversion: 2.1 time: 0.930808 Apr 16 16:54:09.367923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 340/646] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:08 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1682 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:09.433897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c1743410-bc69-4af4-a617-08905aba906d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:09.434867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c1743410-bc69-4af4-a617-08905aba906d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:09.450122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1743410-bc69-4af4-a617-08905aba906d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:09.453096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1743410-bc69-4af4-a617-08905aba906d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:09.454362 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1743410-bc69-4af4-a617-08905aba906d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:09.457139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1743410-bc69-4af4-a617-08905aba906d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:09.838264 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c1743410-bc69-4af4-a617-08905aba906d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:09.854710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c1743410-bc69-4af4-a617-08905aba906d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1319 microversion: 2.1 time: 0.424761 Apr 16 16:54:09.859292 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 307/647] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:09 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:10.387336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d84a6d15-466d-42d7-95bd-8971b28fc961 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:10.388622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d84a6d15-466d-42d7-95bd-8971b28fc961 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:10.402222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d84a6d15-466d-42d7-95bd-8971b28fc961 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:10.415119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d84a6d15-466d-42d7-95bd-8971b28fc961 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:10.416328 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d84a6d15-466d-42d7-95bd-8971b28fc961 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:10.416976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d84a6d15-466d-42d7-95bd-8971b28fc961 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:10.874712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-66f3d529-16e1-4c48-8fd3-aa7a566524db tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:10.876202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-66f3d529-16e1-4c48-8fd3-aa7a566524db tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:10.889859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-66f3d529-16e1-4c48-8fd3-aa7a566524db tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:10.895479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-66f3d529-16e1-4c48-8fd3-aa7a566524db tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:10.898377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-66f3d529-16e1-4c48-8fd3-aa7a566524db tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:10.901660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-66f3d529-16e1-4c48-8fd3-aa7a566524db tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:11.575057 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d84a6d15-466d-42d7-95bd-8971b28fc961 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:11.587033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d84a6d15-466d-42d7-95bd-8971b28fc961 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1682 microversion: 2.1 time: 1.203585 Apr 16 16:54:11.587998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 341/648] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:10 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1682 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:11.986404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-66f3d529-16e1-4c48-8fd3-aa7a566524db tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:12.020093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-66f3d529-16e1-4c48-8fd3-aa7a566524db tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1361 microversion: 2.1 time: 1.149053 Apr 16 16:54:12.021349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 308/649] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:10 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1361 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:12.616060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-de25d864-e097-49a6-a547-f81fcf6d9aeb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:12.617132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-de25d864-e097-49a6-a547-f81fcf6d9aeb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:12.659961 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de25d864-e097-49a6-a547-f81fcf6d9aeb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:12.660886 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de25d864-e097-49a6-a547-f81fcf6d9aeb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:12.661819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de25d864-e097-49a6-a547-f81fcf6d9aeb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:12.662367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de25d864-e097-49a6-a547-f81fcf6d9aeb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:13.047189 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dedbea6b-2733-4f34-85a2-1b73e01d9ba4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:13.050840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dedbea6b-2733-4f34-85a2-1b73e01d9ba4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:13.088471 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dedbea6b-2733-4f34-85a2-1b73e01d9ba4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:13.089597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dedbea6b-2733-4f34-85a2-1b73e01d9ba4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:13.090905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dedbea6b-2733-4f34-85a2-1b73e01d9ba4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:13.092555 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dedbea6b-2733-4f34-85a2-1b73e01d9ba4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:14.991164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-de25d864-e097-49a6-a547-f81fcf6d9aeb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:15.041381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-de25d864-e097-49a6-a547-f81fcf6d9aeb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1682 microversion: 2.1 time: 2.427946 Apr 16 16:54:15.045656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 342/650] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:12 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1682 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:15.318997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dedbea6b-2733-4f34-85a2-1b73e01d9ba4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:15.346145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dedbea6b-2733-4f34-85a2-1b73e01d9ba4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1361 microversion: 2.1 time: 2.310900 Apr 16 16:54:15.346842 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 309/651] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:13 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1361 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:16.066119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c60ccc3c-d9bd-4a09-ae29-cdc6a04328d4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:16.067415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c60ccc3c-d9bd-4a09-ae29-cdc6a04328d4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:16.087936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c60ccc3c-d9bd-4a09-ae29-cdc6a04328d4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:16.089850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c60ccc3c-d9bd-4a09-ae29-cdc6a04328d4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:16.091296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c60ccc3c-d9bd-4a09-ae29-cdc6a04328d4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:16.091934 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c60ccc3c-d9bd-4a09-ae29-cdc6a04328d4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:16.364576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5b6b6023-5bcf-4d51-86c5-ac35959a2ef9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:16.365722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5b6b6023-5bcf-4d51-86c5-ac35959a2ef9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:16.388115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b6b6023-5bcf-4d51-86c5-ac35959a2ef9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:16.388897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b6b6023-5bcf-4d51-86c5-ac35959a2ef9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:16.395823 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b6b6023-5bcf-4d51-86c5-ac35959a2ef9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:16.396758 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5b6b6023-5bcf-4d51-86c5-ac35959a2ef9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:17.518162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c60ccc3c-d9bd-4a09-ae29-cdc6a04328d4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:17.540847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c60ccc3c-d9bd-4a09-ae29-cdc6a04328d4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1682 microversion: 2.1 time: 1.479244 Apr 16 16:54:17.544655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 343/652] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:16 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1682 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:17.968763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5b6b6023-5bcf-4d51-86c5-ac35959a2ef9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:17.980146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5b6b6023-5bcf-4d51-86c5-ac35959a2ef9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1361 microversion: 2.1 time: 1.619579 Apr 16 16:54:17.981813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 310/653] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:16 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1361 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:54:18.579357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-be6738fd-4563-45df-a44f-6bee2648f7dc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:18.580743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-be6738fd-4563-45df-a44f-6bee2648f7dc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:18.590004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be6738fd-4563-45df-a44f-6bee2648f7dc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:18.590913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be6738fd-4563-45df-a44f-6bee2648f7dc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:18.592432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be6738fd-4563-45df-a44f-6bee2648f7dc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:18.594114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be6738fd-4563-45df-a44f-6bee2648f7dc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:19.000643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f839f9d4-5a41-4cfa-8636-e0e6fcd96f6d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:19.001872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f839f9d4-5a41-4cfa-8636-e0e6fcd96f6d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:19.041231 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f839f9d4-5a41-4cfa-8636-e0e6fcd96f6d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:19.041742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f839f9d4-5a41-4cfa-8636-e0e6fcd96f6d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:19.042678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f839f9d4-5a41-4cfa-8636-e0e6fcd96f6d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:19.043159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f839f9d4-5a41-4cfa-8636-e0e6fcd96f6d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:19.731101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-be6738fd-4563-45df-a44f-6bee2648f7dc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:19.743552 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-be6738fd-4563-45df-a44f-6bee2648f7dc tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1682 microversion: 2.1 time: 1.181793 Apr 16 16:54:19.755428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 344/654] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:18 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1682 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:19.761244 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-c69a1369-c042-4018-a697-e788339d631c req-7b3eeb1a-703e-41ef-8085-7dee5b21cf83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f254d3-c0d6-4c32-897b-e19f47934010", "tag": "48feea5a-19f4-4f16-80f8-5166404c8b45"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:19.763709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:54:19.763709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:54:19.775666 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-c69a1369-c042-4018-a697-e788339d631c req-7b3eeb1a-703e-41ef-8085-7dee5b21cf83 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:19.776572 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-c69a1369-c042-4018-a697-e788339d631c req-7b3eeb1a-703e-41ef-8085-7dee5b21cf83 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:19.817871 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-c69a1369-c042-4018-a697-e788339d631c req-7b3eeb1a-703e-41ef-8085-7dee5b21cf83 service nova] Creating event network-changed:48feea5a-19f4-4f16-80f8-5166404c8b45 for instance a0f254d3-c0d6-4c32-897b-e19f47934010 on hv-cinder-73362 Apr 16 16:54:19.824357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-c69a1369-c042-4018-a697-e788339d631c req-7b3eeb1a-703e-41ef-8085-7dee5b21cf83 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067115 Apr 16 16:54:19.825307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 345/655] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:54:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:54:19.878049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f839f9d4-5a41-4cfa-8636-e0e6fcd96f6d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:19.899526 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f839f9d4-5a41-4cfa-8636-e0e6fcd96f6d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1361 microversion: 2.1 time: 0.904299 Apr 16 16:54:19.900159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 311/656] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:18 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1361 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:54:20.790931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-461c39bc-a5a3-4202-8fa6-d8a796eeeb51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:20.793368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-461c39bc-a5a3-4202-8fa6-d8a796eeeb51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:20.831293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-461c39bc-a5a3-4202-8fa6-d8a796eeeb51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:20.833936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-461c39bc-a5a3-4202-8fa6-d8a796eeeb51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:20.836014 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-461c39bc-a5a3-4202-8fa6-d8a796eeeb51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:20.836986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-461c39bc-a5a3-4202-8fa6-d8a796eeeb51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:20.922805 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a3cd03b6-607e-472c-acef-4aa63c06eafb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:20.927569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a3cd03b6-607e-472c-acef-4aa63c06eafb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:20.960103 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a3cd03b6-607e-472c-acef-4aa63c06eafb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:20.961936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a3cd03b6-607e-472c-acef-4aa63c06eafb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:20.967657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a3cd03b6-607e-472c-acef-4aa63c06eafb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:20.969595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a3cd03b6-607e-472c-acef-4aa63c06eafb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:21.392901 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-461c39bc-a5a3-4202-8fa6-d8a796eeeb51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:21.407846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-461c39bc-a5a3-4202-8fa6-d8a796eeeb51 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1682 microversion: 2.1 time: 0.634055 Apr 16 16:54:21.408794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 346/657] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:20 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1682 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:21.508461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a3cd03b6-607e-472c-acef-4aa63c06eafb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:21.526893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a3cd03b6-607e-472c-acef-4aa63c06eafb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1361 microversion: 2.1 time: 0.611167 Apr 16 16:54:21.527454 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 312/658] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:20 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1361 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:21.661004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7910f9de-49b2-43f7-8118-4e4f9310a5b5 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Action: 'create', calling method: .version_select at 0x7f0d446f5400>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1299146718", "metadata": {"Type": "work"}}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:21.664027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7910f9de-49b2-43f7-8118-4e4f9310a5b5 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:54:21.668471 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7910f9de-49b2-43f7-8118-4e4f9310a5b5 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] 10.222.0.103 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.257512 Apr 16 16:54:21.669545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 347/659] 10.222.0.103 () {60 vars in 1151 bytes} [Fri Apr 16 16:54:21 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 16:54:21.681183 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c549053b-949b-4268-806b-4a6864ab9a73 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Action: 'create', calling method: .version_select at 0x7f0d4463aea0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1458737306", "metadata": {"Type": "work"}}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:21.683001 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c549053b-949b-4268-806b-4a6864ab9a73 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:54:21.684303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c549053b-949b-4268-806b-4a6864ab9a73 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] 10.222.0.103 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006820 Apr 16 16:54:21.684401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 313/660] 10.222.0.103 () {60 vars in 1151 bytes} [Fri Apr 16 16:54:21 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 16:54:21.695748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-27d774a1-645f-473c-8a76-4e478c2e7a8a tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Action: 'create', calling method: .version_select at 0x7f0d448b9378>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1413059136", "metadata": {"Type": "work"}}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:21.697406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-27d774a1-645f-473c-8a76-4e478c2e7a8a tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:54:21.698182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-27d774a1-645f-473c-8a76-4e478c2e7a8a tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] 10.222.0.103 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006395 Apr 16 16:54:21.699107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 348/661] 10.222.0.103 () {60 vars in 1151 bytes} [Fri Apr 16 16:54:21 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 16:54:21.710158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5968a423-fc7e-4e74-95c8-57a71acf6551 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Calling method '.version_select at 0x7f0d44673c80>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:21.813194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-5968a423-fc7e-4e74-95c8-57a71acf6551 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] HTTP exception thrown: Volume tempest-invalid-291773417 could not be found. Apr 16 16:54:21.814155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5968a423-fc7e-4e74-95c8-57a71acf6551 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Returning 404 to user: Volume tempest-invalid-291773417 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:54:21.815819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5968a423-fc7e-4e74-95c8-57a71acf6551 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] 10.222.0.103 "DELETE /compute/v2.1/os-volumes/tempest-invalid-291773417" status: 404 len: 98 microversion: 2.1 time: 0.110343 Apr 16 16:54:21.817352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 314/662] 10.222.0.103 () {58 vars in 1210 bytes} [Fri Apr 16 16:54:21 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-291773417 => generated 98 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 16:54:21.828433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-aaf61e9a-718c-4f62-a20d-d6f52d957ee6 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] 10.222.0.103 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005065 Apr 16 16:54:21.829354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 349/663] 10.222.0.103 () {58 vars in 1135 bytes} [Fri Apr 16 16:54:21 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 16 16:54:21.840451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5e19ce01-e44f-43ec-8962-0ae6de1ed1c0 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004792 Apr 16 16:54:21.841034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 315/664] 10.222.0.103 () {58 vars in 1132 bytes} [Fri Apr 16 16:54:21 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 16 16:54:21.855341 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f06dc46d-1766-4a93-bb6a-7c99e668743b tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Calling method '.version_select at 0x7f0d45191730>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:21.868809 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-7689fdcd-1bce-4c7a-b3ef-17cefc1e58f2 req-fc356b10-d2a8-4a6d-85ef-06a77795e9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954b9698-4e4c-4bd2-9cba-021819421e40", "tag": "c82bdbb9-8da8-4836-a28f-01855d319f56"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:21.876279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:54:21.876279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:54:21.910804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-7689fdcd-1bce-4c7a-b3ef-17cefc1e58f2 req-fc356b10-d2a8-4a6d-85ef-06a77795e9b9 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:21.911343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-7689fdcd-1bce-4c7a-b3ef-17cefc1e58f2 req-fc356b10-d2a8-4a6d-85ef-06a77795e9b9 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:21.952293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-7689fdcd-1bce-4c7a-b3ef-17cefc1e58f2 req-fc356b10-d2a8-4a6d-85ef-06a77795e9b9 service nova] Creating event network-changed:c82bdbb9-8da8-4836-a28f-01855d319f56 for instance 954b9698-4e4c-4bd2-9cba-021819421e40 on hv-cinder-73362 Apr 16 16:54:21.965595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-7689fdcd-1bce-4c7a-b3ef-17cefc1e58f2 req-fc356b10-d2a8-4a6d-85ef-06a77795e9b9 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102749 Apr 16 16:54:21.966401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 316/665] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:54:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:54:21.992267 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-f06dc46d-1766-4a93-bb6a-7c99e668743b tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] HTTP exception thrown: Volume 5c08fed8-fcd9-4147-8941-9ba6ec001070 could not be found. Apr 16 16:54:21.993390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f06dc46d-1766-4a93-bb6a-7c99e668743b tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Returning 404 to user: Volume 5c08fed8-fcd9-4147-8941-9ba6ec001070 could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:54:21.993832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f06dc46d-1766-4a93-bb6a-7c99e668743b tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] 10.222.0.103 "DELETE /compute/v2.1/os-volumes/5c08fed8-fcd9-4147-8941-9ba6ec001070" status: 404 len: 109 microversion: 2.1 time: 0.143935 Apr 16 16:54:21.994458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 350/666] 10.222.0.103 () {58 vars in 1243 bytes} [Fri Apr 16 16:54:21 2021] DELETE /compute/v2.1/os-volumes/5c08fed8-fcd9-4147-8941-9ba6ec001070 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:54:22.009257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-76f898bd-46a9-4fa1-9d04-2b7b1bd36c63 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Calling method '.version_select at 0x7f0d469bdc80>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:22.168481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-76f898bd-46a9-4fa1-9d04-2b7b1bd36c63 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] HTTP exception thrown: Volume 6ac2f135-3479-4846-b5fb-575114cf1d3b could not be found. Apr 16 16:54:22.169415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-76f898bd-46a9-4fa1-9d04-2b7b1bd36c63 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] Returning 404 to user: Volume 6ac2f135-3479-4846-b5fb-575114cf1d3b could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:54:22.171239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-76f898bd-46a9-4fa1-9d04-2b7b1bd36c63 tempest-VolumesNegativeTest-334845892 tempest-VolumesNegativeTest-334845892-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/6ac2f135-3479-4846-b5fb-575114cf1d3b" status: 404 len: 109 microversion: 2.1 time: 0.168642 Apr 16 16:54:22.173200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 317/667] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:54:21 2021] GET /compute/v2.1/os-volumes/6ac2f135-3479-4846-b5fb-575114cf1d3b => generated 109 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:54:22.435483 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-07a40f4b-c7d0-429f-9075-e5c4f447a50c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:22.438655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-07a40f4b-c7d0-429f-9075-e5c4f447a50c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:22.458311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07a40f4b-c7d0-429f-9075-e5c4f447a50c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:22.459561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07a40f4b-c7d0-429f-9075-e5c4f447a50c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:22.461442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07a40f4b-c7d0-429f-9075-e5c4f447a50c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:22.462751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-07a40f4b-c7d0-429f-9075-e5c4f447a50c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:22.554370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0911910b-a9e8-4964-9ae7-59a1cd95b7d1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:22.556120 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0911910b-a9e8-4964-9ae7-59a1cd95b7d1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:22.577369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0911910b-a9e8-4964-9ae7-59a1cd95b7d1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:22.580365 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0911910b-a9e8-4964-9ae7-59a1cd95b7d1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:22.582102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0911910b-a9e8-4964-9ae7-59a1cd95b7d1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:22.583228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0911910b-a9e8-4964-9ae7-59a1cd95b7d1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:23.342999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-07a40f4b-c7d0-429f-9075-e5c4f447a50c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:23.365021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-07a40f4b-c7d0-429f-9075-e5c4f447a50c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1659 microversion: 2.1 time: 0.940459 Apr 16 16:54:23.366095 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 351/668] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:22 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1659 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:23.374061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0911910b-a9e8-4964-9ae7-59a1cd95b7d1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:23.391052 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-52943b11-3dd9-4ce0-98fa-74e4b228ff21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:23.394940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0911910b-a9e8-4964-9ae7-59a1cd95b7d1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1361 microversion: 2.1 time: 0.852200 Apr 16 16:54:23.395751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 318/669] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:22 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1361 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:23.412424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52943b11-3dd9-4ce0-98fa-74e4b228ff21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:23.412942 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52943b11-3dd9-4ce0-98fa-74e4b228ff21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:23.547665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-52943b11-3dd9-4ce0-98fa-74e4b228ff21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Going to try to start instance {{(pid=99398) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 16 16:54:23.658136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-52943b11-3dd9-4ce0-98fa-74e4b228ff21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action" status: 202 len: 0 microversion: 2.1 time: 0.273817 Apr 16 16:54:23.659126 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 352/670] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:54:23 2021] POST /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:54:23.669904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f65f993b-d921-4560-b722-b5bbca574819 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:23.670852 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f65f993b-d921-4560-b722-b5bbca574819 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:23.680967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f65f993b-d921-4560-b722-b5bbca574819 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:23.681574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f65f993b-d921-4560-b722-b5bbca574819 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:23.682581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f65f993b-d921-4560-b722-b5bbca574819 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:23.683283 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f65f993b-d921-4560-b722-b5bbca574819 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:24.322696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f65f993b-d921-4560-b722-b5bbca574819 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:24.338212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f65f993b-d921-4560-b722-b5bbca574819 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1668 microversion: 2.1 time: 0.672503 Apr 16 16:54:24.340949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 319/671] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:23 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1668 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:54:24.418919 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6378c95d-75e1-4b32-845a-ab92c8b7eeeb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:24.420496 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6378c95d-75e1-4b32-845a-ab92c8b7eeeb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:24.435596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6378c95d-75e1-4b32-845a-ab92c8b7eeeb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:24.436506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6378c95d-75e1-4b32-845a-ab92c8b7eeeb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:24.439021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6378c95d-75e1-4b32-845a-ab92c8b7eeeb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:24.439873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6378c95d-75e1-4b32-845a-ab92c8b7eeeb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:24.853753 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6378c95d-75e1-4b32-845a-ab92c8b7eeeb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:24.869964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6378c95d-75e1-4b32-845a-ab92c8b7eeeb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1361 microversion: 2.1 time: 0.458508 Apr 16 16:54:24.871110 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 353/672] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:24 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1361 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:25.363608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-27cd92d8-12d9-443b-b105-22a9042c0b79 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:25.364239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-27cd92d8-12d9-443b-b105-22a9042c0b79 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:25.375476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27cd92d8-12d9-443b-b105-22a9042c0b79 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:25.376365 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27cd92d8-12d9-443b-b105-22a9042c0b79 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:25.377665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27cd92d8-12d9-443b-b105-22a9042c0b79 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:25.378177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27cd92d8-12d9-443b-b105-22a9042c0b79 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:25.660032 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-27cd92d8-12d9-443b-b105-22a9042c0b79 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:25.671572 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-27cd92d8-12d9-443b-b105-22a9042c0b79 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1668 microversion: 2.1 time: 0.313770 Apr 16 16:54:25.672892 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 320/673] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:25 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1668 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:25.904786 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9b73b702-d80e-44d7-917b-af6df48c037e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:25.905850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9b73b702-d80e-44d7-917b-af6df48c037e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:25.932464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b73b702-d80e-44d7-917b-af6df48c037e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:25.933565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b73b702-d80e-44d7-917b-af6df48c037e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:25.939928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b73b702-d80e-44d7-917b-af6df48c037e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:25.940928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b73b702-d80e-44d7-917b-af6df48c037e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:26.329114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9b73b702-d80e-44d7-917b-af6df48c037e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:26.353765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9b73b702-d80e-44d7-917b-af6df48c037e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1361 microversion: 2.1 time: 0.454708 Apr 16 16:54:26.354702 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 354/674] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:25 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1361 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:26.695614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d2684d00-d293-44f4-9a1e-387d7b3bd1fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:26.696935 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d2684d00-d293-44f4-9a1e-387d7b3bd1fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:26.712713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d2684d00-d293-44f4-9a1e-387d7b3bd1fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:26.713797 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d2684d00-d293-44f4-9a1e-387d7b3bd1fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:26.715586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d2684d00-d293-44f4-9a1e-387d7b3bd1fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:26.725539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d2684d00-d293-44f4-9a1e-387d7b3bd1fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:27.063440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d2684d00-d293-44f4-9a1e-387d7b3bd1fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:27.091723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d2684d00-d293-44f4-9a1e-387d7b3bd1fa tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1672 microversion: 2.1 time: 0.402441 Apr 16 16:54:27.119299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 321/675] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:26 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1672 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:27.378181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-21d1ce0b-1b33-45be-a7b4-5422f672d842 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:27.379339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-21d1ce0b-1b33-45be-a7b4-5422f672d842 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:27.387701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21d1ce0b-1b33-45be-a7b4-5422f672d842 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:27.388429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21d1ce0b-1b33-45be-a7b4-5422f672d842 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:27.389519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21d1ce0b-1b33-45be-a7b4-5422f672d842 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:27.390098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-21d1ce0b-1b33-45be-a7b4-5422f672d842 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:27.680456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-21d1ce0b-1b33-45be-a7b4-5422f672d842 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:27.691443 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-21d1ce0b-1b33-45be-a7b4-5422f672d842 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1361 microversion: 2.1 time: 0.318753 Apr 16 16:54:27.692993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 355/676] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:27 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1361 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:28.467027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-4a13eb6d-6866-4475-ad3a-942bb994edce req-c724bcb1-30d7-4ccb-885e-78ec151c2bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f254d3-c0d6-4c32-897b-e19f47934010", "name": "network-vif-plugged", "status": "completed", "tag": "48feea5a-19f4-4f16-80f8-5166404c8b45"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:28.470368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:54:28.470368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:54:28.483768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-4a13eb6d-6866-4475-ad3a-942bb994edce req-c724bcb1-30d7-4ccb-885e-78ec151c2bf2 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:28.484815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-4a13eb6d-6866-4475-ad3a-942bb994edce req-c724bcb1-30d7-4ccb-885e-78ec151c2bf2 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:28.512162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-4a13eb6d-6866-4475-ad3a-942bb994edce req-c724bcb1-30d7-4ccb-885e-78ec151c2bf2 service nova] Creating event network-vif-plugged:48feea5a-19f4-4f16-80f8-5166404c8b45 for instance a0f254d3-c0d6-4c32-897b-e19f47934010 on hv-cinder-73362 Apr 16 16:54:28.519632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-4a13eb6d-6866-4475-ad3a-942bb994edce req-c724bcb1-30d7-4ccb-885e-78ec151c2bf2 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060232 Apr 16 16:54:28.520893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 322/677] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:54:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:54:28.709988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-70cd01a8-519f-4552-a760-9acee49362ac tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:28.710804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-70cd01a8-519f-4552-a760-9acee49362ac tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:28.721361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-70cd01a8-519f-4552-a760-9acee49362ac tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:28.721907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-70cd01a8-519f-4552-a760-9acee49362ac tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:28.723971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-70cd01a8-519f-4552-a760-9acee49362ac tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:28.724313 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-70cd01a8-519f-4552-a760-9acee49362ac tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:29.044880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-70cd01a8-519f-4552-a760-9acee49362ac tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:29.056700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-70cd01a8-519f-4552-a760-9acee49362ac tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1361 microversion: 2.1 time: 0.351025 Apr 16 16:54:29.057662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 356/678] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:28 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1361 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:30.077452 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3174d2e7-6a81-4ae4-ba8e-27ff2fd85afe tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:30.078272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3174d2e7-6a81-4ae4-ba8e-27ff2fd85afe tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:30.091040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3174d2e7-6a81-4ae4-ba8e-27ff2fd85afe tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:30.091714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3174d2e7-6a81-4ae4-ba8e-27ff2fd85afe tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:30.093505 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3174d2e7-6a81-4ae4-ba8e-27ff2fd85afe tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:30.094448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3174d2e7-6a81-4ae4-ba8e-27ff2fd85afe tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:30.378474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3174d2e7-6a81-4ae4-ba8e-27ff2fd85afe tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:30.389264 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3174d2e7-6a81-4ae4-ba8e-27ff2fd85afe tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1550 microversion: 2.1 time: 0.316242 Apr 16 16:54:30.390232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 323/679] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:30 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1550 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:30.411616 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-34d3dc62-4a9e-46fe-9420-a8c30b1854a3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:30.412539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-34d3dc62-4a9e-46fe-9420-a8c30b1854a3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:30.422993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34d3dc62-4a9e-46fe-9420-a8c30b1854a3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:30.423538 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34d3dc62-4a9e-46fe-9420-a8c30b1854a3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:30.424661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34d3dc62-4a9e-46fe-9420-a8c30b1854a3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:30.425305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34d3dc62-4a9e-46fe-9420-a8c30b1854a3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:30.705696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-34d3dc62-4a9e-46fe-9420-a8c30b1854a3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:30.723529 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-34d3dc62-4a9e-46fe-9420-a8c30b1854a3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1550 microversion: 2.1 time: 0.318078 Apr 16 16:54:30.724223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 357/680] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:30 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1550 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:30.744039 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5727bde0-a7d2-4d96-9383-3ff655fbd893 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:30.747970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:54:30.747970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:54:30.750153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5727bde0-a7d2-4d96-9383-3ff655fbd893 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:30.761717 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5727bde0-a7d2-4d96-9383-3ff655fbd893 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Searching by: {'deleted': False, 'project_id': '0944f6a6bc094a1db167f95dea7b6570'} {{(pid=99399) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 16 16:54:30.769853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5727bde0-a7d2-4d96-9383-3ff655fbd893 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:30.770488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5727bde0-a7d2-4d96-9383-3ff655fbd893 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:30.771433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5727bde0-a7d2-4d96-9383-3ff655fbd893 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:30.772003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5727bde0-a7d2-4d96-9383-3ff655fbd893 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:30.896467 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.multi_cell_list [None req-5727bde0-a7d2-4d96-9383-3ff655fbd893 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=99399) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 16 16:54:31.009673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5727bde0-a7d2-4d96-9383-3ff655fbd893 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.269322 Apr 16 16:54:31.010555 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 324/681] 10.222.0.103 () {58 vars in 1120 bytes} [Fri Apr 16 16:54:30 2021] GET /compute/v2.1/servers => generated 343 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:54:31.030389 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-280dfa42-4207-481b-a810-f7a87a5e8b36 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:31.031617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-280dfa42-4207-481b-a810-f7a87a5e8b36 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:31.046747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-280dfa42-4207-481b-a810-f7a87a5e8b36 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:31.051336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-280dfa42-4207-481b-a810-f7a87a5e8b36 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:31.053381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-280dfa42-4207-481b-a810-f7a87a5e8b36 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:31.054436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-280dfa42-4207-481b-a810-f7a87a5e8b36 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:31.533922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-280dfa42-4207-481b-a810-f7a87a5e8b36 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:31.543833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-280dfa42-4207-481b-a810-f7a87a5e8b36 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1550 microversion: 2.1 time: 0.517694 Apr 16 16:54:31.544467 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 358/682] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:31 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1550 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:34.954729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f3f4530e-982a-4761-a16f-a7e1a6117609 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:34.955383 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f3f4530e-982a-4761-a16f-a7e1a6117609 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:34.963504 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f3f4530e-982a-4761-a16f-a7e1a6117609 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:34.964010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f3f4530e-982a-4761-a16f-a7e1a6117609 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:34.964852 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f3f4530e-982a-4761-a16f-a7e1a6117609 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:34.965451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f3f4530e-982a-4761-a16f-a7e1a6117609 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:35.041938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f3f4530e-982a-4761-a16f-a7e1a6117609 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/os-volume_attachments/cacc271b-eb4b-453e-9f43-7637f2372c09" status: 200 len: 194 microversion: 2.20 time: 0.092250 Apr 16 16:54:35.042960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 325/683] 10.222.0.103 () {60 vars in 1449 bytes} [Fri Apr 16 16:54:34 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/os-volume_attachments/cacc271b-eb4b-453e-9f43-7637f2372c09 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:54:35.163927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ddfe35c7-4882-4988-89e2-a0af904a82ba tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:35.164511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ddfe35c7-4882-4988-89e2-a0af904a82ba tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:35.173315 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ddfe35c7-4882-4988-89e2-a0af904a82ba tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:35.174091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ddfe35c7-4882-4988-89e2-a0af904a82ba tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:35.175178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ddfe35c7-4882-4988-89e2-a0af904a82ba tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:35.175669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ddfe35c7-4882-4988-89e2-a0af904a82ba tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:35.357314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-ddfe35c7-4882-4988-89e2-a0af904a82ba tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lazy-loading 'services' on Instance uuid bf021fce-d230-4117-992c-f91cd978276c {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:54:35.544084 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ddfe35c7-4882-4988-89e2-a0af904a82ba tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "DELETE /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/os-volume_attachments/cacc271b-eb4b-453e-9f43-7637f2372c09" status: 202 len: 0 microversion: 2.20 time: 0.383998 Apr 16 16:54:35.544716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 359/684] 10.222.0.103 () {60 vars in 1452 bytes} [Fri Apr 16 16:54:35 2021] DELETE /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c/os-volume_attachments/cacc271b-eb4b-453e-9f43-7637f2372c09 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:54:35.875272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fce632f3-5f7a-450c-b004-4d8ada5f00ce tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d42a8388-91e8-4b2c-875a-4be8ceb3d540"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:35.876744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fce632f3-5f7a-450c-b004-4d8ada5f00ce tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:35.885073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fce632f3-5f7a-450c-b004-4d8ada5f00ce tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:35.885831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fce632f3-5f7a-450c-b004-4d8ada5f00ce tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:35.886702 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fce632f3-5f7a-450c-b004-4d8ada5f00ce tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:35.887195 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fce632f3-5f7a-450c-b004-4d8ada5f00ce tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:36.393579 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fce632f3-5f7a-450c-b004-4d8ada5f00ce tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "POST /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522431 Apr 16 16:54:36.394375 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 326/685] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:54:35 2021] POST /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:54:36.912558 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9c455b80-8225-468e-8404-b681044c5a0d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:36.913369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9c455b80-8225-468e-8404-b681044c5a0d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:36.923059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9c455b80-8225-468e-8404-b681044c5a0d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:36.923691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9c455b80-8225-468e-8404-b681044c5a0d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:36.924759 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9c455b80-8225-468e-8404-b681044c5a0d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:36.925441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9c455b80-8225-468e-8404-b681044c5a0d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:37.023149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9c455b80-8225-468e-8404-b681044c5a0d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:54:37.167469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9c455b80-8225-468e-8404-b681044c5a0d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "DELETE /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 204 len: 0 microversion: 2.20 time: 0.259282 Apr 16 16:54:37.168195 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 360/686] 10.222.0.103 () {60 vars in 1275 bytes} [Fri Apr 16 16:54:36 2021] DELETE /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 16:54:37.178632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ad5eb05a-d104-484f-86e9-eaddd6601284 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:37.179401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ad5eb05a-d104-484f-86e9-eaddd6601284 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:37.189638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ad5eb05a-d104-484f-86e9-eaddd6601284 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:37.190148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ad5eb05a-d104-484f-86e9-eaddd6601284 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:37.191034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ad5eb05a-d104-484f-86e9-eaddd6601284 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:37.191530 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ad5eb05a-d104-484f-86e9-eaddd6601284 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:37.601377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ad5eb05a-d104-484f-86e9-eaddd6601284 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:37.611662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ad5eb05a-d104-484f-86e9-eaddd6601284 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:37.613355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ad5eb05a-d104-484f-86e9-eaddd6601284 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:37.614602 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ad5eb05a-d104-484f-86e9-eaddd6601284 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.441478 Apr 16 16:54:37.615223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 327/687] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:37 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:54:38.637850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bb8c3ccf-104c-49b1-86dc-3d87b4ff84e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:38.638733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bb8c3ccf-104c-49b1-86dc-3d87b4ff84e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:38.647708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bb8c3ccf-104c-49b1-86dc-3d87b4ff84e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:38.648220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bb8c3ccf-104c-49b1-86dc-3d87b4ff84e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:38.649322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bb8c3ccf-104c-49b1-86dc-3d87b4ff84e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:38.649816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bb8c3ccf-104c-49b1-86dc-3d87b4ff84e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:38.932241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bb8c3ccf-104c-49b1-86dc-3d87b4ff84e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:38.943804 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bb8c3ccf-104c-49b1-86dc-3d87b4ff84e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:38.946223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bb8c3ccf-104c-49b1-86dc-3d87b4ff84e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:38.947622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bb8c3ccf-104c-49b1-86dc-3d87b4ff84e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.314652 Apr 16 16:54:38.948281 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 361/688] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:38 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:54:39.967775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-27b19e9e-e9b8-4973-9c77-e840346f5023 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:39.968489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-27b19e9e-e9b8-4973-9c77-e840346f5023 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:39.978047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27b19e9e-e9b8-4973-9c77-e840346f5023 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:39.978523 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27b19e9e-e9b8-4973-9c77-e840346f5023 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:39.979476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27b19e9e-e9b8-4973-9c77-e840346f5023 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:39.980117 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27b19e9e-e9b8-4973-9c77-e840346f5023 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:40.285752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-27b19e9e-e9b8-4973-9c77-e840346f5023 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:40.296516 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-27b19e9e-e9b8-4973-9c77-e840346f5023 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:40.298323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-27b19e9e-e9b8-4973-9c77-e840346f5023 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:40.299601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-27b19e9e-e9b8-4973-9c77-e840346f5023 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1728 microversion: 2.20 time: 0.337239 Apr 16 16:54:40.300318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 328/689] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:39 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1728 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:54:41.321126 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-425081bf-c16a-46b7-8de0-2a7ac0512d07 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:41.322396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-425081bf-c16a-46b7-8de0-2a7ac0512d07 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:41.336149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-425081bf-c16a-46b7-8de0-2a7ac0512d07 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:41.336840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-425081bf-c16a-46b7-8de0-2a7ac0512d07 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:41.338488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-425081bf-c16a-46b7-8de0-2a7ac0512d07 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:41.339176 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-425081bf-c16a-46b7-8de0-2a7ac0512d07 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:41.410361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-0e3100c3-8b00-4d6a-9529-aa374595a499 req-f7e395b6-917c-44d8-9ab0-791bde2fe902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf021fce-d230-4117-992c-f91cd978276c", "name": "network-vif-deleted", "tag": "fd825542-a1af-4ba6-8c00-d64d5199c7e6"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:41.412718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:54:41.412718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:54:41.438735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-0e3100c3-8b00-4d6a-9529-aa374595a499 req-f7e395b6-917c-44d8-9ab0-791bde2fe902 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:41.440332 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-0e3100c3-8b00-4d6a-9529-aa374595a499 req-f7e395b6-917c-44d8-9ab0-791bde2fe902 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:41.483633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-0e3100c3-8b00-4d6a-9529-aa374595a499 req-f7e395b6-917c-44d8-9ab0-791bde2fe902 service nova] Creating event network-vif-deleted:fd825542-a1af-4ba6-8c00-d64d5199c7e6 for instance bf021fce-d230-4117-992c-f91cd978276c on hv-cinder-73362 Apr 16 16:54:41.492361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-0e3100c3-8b00-4d6a-9529-aa374595a499 req-f7e395b6-917c-44d8-9ab0-791bde2fe902 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087788 Apr 16 16:54:41.493273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 329/690] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:54:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:54:41.532158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-425081bf-c16a-46b7-8de0-2a7ac0512d07 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:41.545021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-425081bf-c16a-46b7-8de0-2a7ac0512d07 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:41.546741 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-425081bf-c16a-46b7-8de0-2a7ac0512d07 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:41.547970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-425081bf-c16a-46b7-8de0-2a7ac0512d07 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 200 len: 1661 microversion: 2.20 time: 0.231836 Apr 16 16:54:41.548825 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 362/691] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:41 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 1661 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:54:42.574615 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b714ab9e-c70b-4860-ab59-6acb2cd60e1c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:42.576105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b714ab9e-c70b-4860-ab59-6acb2cd60e1c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:42.585931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b714ab9e-c70b-4860-ab59-6acb2cd60e1c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:42.586796 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b714ab9e-c70b-4860-ab59-6acb2cd60e1c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:42.587858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b714ab9e-c70b-4860-ab59-6acb2cd60e1c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:42.588552 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b714ab9e-c70b-4860-ab59-6acb2cd60e1c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:42.651652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-b714ab9e-c70b-4860-ab59-6acb2cd60e1c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] HTTP exception thrown: Instance bf021fce-d230-4117-992c-f91cd978276c could not be found. Apr 16 16:54:42.651652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b714ab9e-c70b-4860-ab59-6acb2cd60e1c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Returning 404 to user: Instance bf021fce-d230-4117-992c-f91cd978276c could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:54:42.651652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b714ab9e-c70b-4860-ab59-6acb2cd60e1c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 404 len: 111 microversion: 2.20 time: 0.084584 Apr 16 16:54:42.651652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 330/692] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:42 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 16:54:42.662499 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c4552dbd-8da7-4ac5-b8a0-ab8691b900db tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '.version_select at 0x7f0d451919d8>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:42.710589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c4552dbd-8da7-4ac5-b8a0-ab8691b900db tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041989043" status: 204 len: 0 microversion: 2.20 time: 0.042508 Apr 16 16:54:42.710589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 363/693] 10.222.0.103 () {60 vars in 1257 bytes} [Fri Apr 16 16:54:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2041989043 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 16:54:44.784385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-540c3877-e0f0-4785-847e-08c18670ea03 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:44.785798 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-540c3877-e0f0-4785-847e-08c18670ea03 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:44.800140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-540c3877-e0f0-4785-847e-08c18670ea03 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:44.800630 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-540c3877-e0f0-4785-847e-08c18670ea03 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:44.801736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-540c3877-e0f0-4785-847e-08c18670ea03 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:44.802375 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-540c3877-e0f0-4785-847e-08c18670ea03 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:45.218476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-540c3877-e0f0-4785-847e-08c18670ea03 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:45.237011 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-540c3877-e0f0-4785-847e-08c18670ea03 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1596 microversion: 2.1 time: 0.461381 Apr 16 16:54:45.237727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 331/694] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:44 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1596 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:54:45.582322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c3a630de-5b78-4d42-a739-8440a54cc740 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'create', calling method: .version_select at 0x7f0d499cca60>, body: {"keypair": {"name": "tempest-keypair-651552847"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:45.627455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-c3a630de-5b78-4d42-a739-8440a54cc740 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for project fb882053c8e84304847e19528f11d911. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:54:45.632855 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-c3a630de-5b78-4d42-a739-8440a54cc740 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for user f60265b8ee174e36a604896147c47d60 and project fb882053c8e84304847e19528f11d911. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:54:45.745369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-c3a630de-5b78-4d42-a739-8440a54cc740 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for project fb882053c8e84304847e19528f11d911. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:54:45.750554 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-c3a630de-5b78-4d42-a739-8440a54cc740 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for user f60265b8ee174e36a604896147c47d60 and project fb882053c8e84304847e19528f11d911. Resources: {'key_pairs'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:54:45.772775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c3a630de-5b78-4d42-a739-8440a54cc740 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.195469 Apr 16 16:54:45.780360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 364/695] 10.222.0.103 () {62 vars in 1194 bytes} [Fri Apr 16 16:54:45 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 198 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 16 16:54:48.611903 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1947323018", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5636c544-b076-4465-9c13-a664e37a5e03"}], "security_groups": [{"name": "tempest-securitygroup--1763888363"}], "key_name": "tempest-keypair-651552847", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:48.794256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] validate_networks() for [('5636c544-b076-4465-9c13-a664e37a5e03', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:54:49.911448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:54:49.911998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:54:49.913212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:54:49.913687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:54:49.914147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:54:49.932049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:49.934382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:49.936242 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:49.938195 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:49.980765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for project fb882053c8e84304847e19528f11d911. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:54:49.986986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Getting quotas for user f60265b8ee174e36a604896147c47d60 and project fb882053c8e84304847e19528f11d911. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:54:50.003884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:54:50.008040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:54:50.120232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-edbb774e-8ce9-4a63-8364-372bcfea04b2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 1.520036 Apr 16 16:54:50.121229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 332/696] 10.222.0.103 () {62 vars in 1183 bytes} [Fri Apr 16 16:54:48 2021] POST /compute/v2.1/servers => generated 404 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 16 16:54:50.138840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3738f6cc-8ada-4902-9b3a-da4b45e6e3bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:50.139525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3738f6cc-8ada-4902-9b3a-da4b45e6e3bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:50.271139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3738f6cc-8ada-4902-9b3a-da4b45e6e3bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:50.283148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3738f6cc-8ada-4902-9b3a-da4b45e6e3bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:50.285093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3738f6cc-8ada-4902-9b3a-da4b45e6e3bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:50.286262 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3738f6cc-8ada-4902-9b3a-da4b45e6e3bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1285 microversion: 2.20 time: 0.153224 Apr 16 16:54:50.287659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 365/697] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:50 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:54:51.309993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bbf5d64a-efc5-45e4-bf4b-66798ea247d6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:51.311392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bbf5d64a-efc5-45e4-bf4b-66798ea247d6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:51.323378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bbf5d64a-efc5-45e4-bf4b-66798ea247d6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:51.324343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bbf5d64a-efc5-45e4-bf4b-66798ea247d6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:51.325555 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bbf5d64a-efc5-45e4-bf4b-66798ea247d6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:51.326265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bbf5d64a-efc5-45e4-bf4b-66798ea247d6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:51.410255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-109a76d9-f2b6-49da-8465-a08808e2738b req-22971fea-540e-463d-bd24-ea2ec8fac0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f254d3-c0d6-4c32-897b-e19f47934010", "tag": "48feea5a-19f4-4f16-80f8-5166404c8b45"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:51.415852 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:54:51.415852 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:54:51.431318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-109a76d9-f2b6-49da-8465-a08808e2738b req-22971fea-540e-463d-bd24-ea2ec8fac0a2 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:51.443111 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-109a76d9-f2b6-49da-8465-a08808e2738b req-22971fea-540e-463d-bd24-ea2ec8fac0a2 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:51.465944 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-109a76d9-f2b6-49da-8465-a08808e2738b req-22971fea-540e-463d-bd24-ea2ec8fac0a2 service nova] Creating event network-changed:48feea5a-19f4-4f16-80f8-5166404c8b45 for instance a0f254d3-c0d6-4c32-897b-e19f47934010 on hv-cinder-73362 Apr 16 16:54:51.472752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-109a76d9-f2b6-49da-8465-a08808e2738b req-22971fea-540e-463d-bd24-ea2ec8fac0a2 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069362 Apr 16 16:54:51.477494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 366/698] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:54:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:54:51.778682 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bbf5d64a-efc5-45e4-bf4b-66798ea247d6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:51.799910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bbf5d64a-efc5-45e4-bf4b-66798ea247d6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:51.802079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bbf5d64a-efc5-45e4-bf4b-66798ea247d6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:51.803507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bbf5d64a-efc5-45e4-bf4b-66798ea247d6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1281 microversion: 2.20 time: 0.498278 Apr 16 16:54:51.804320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 333/699] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:51 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1281 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:54:52.840344 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-461b51d2-1ccf-4e32-9d60-91960ee91407 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:52.841122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-461b51d2-1ccf-4e32-9d60-91960ee91407 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:52.851937 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-461b51d2-1ccf-4e32-9d60-91960ee91407 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:52.853148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-461b51d2-1ccf-4e32-9d60-91960ee91407 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:52.854205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-461b51d2-1ccf-4e32-9d60-91960ee91407 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:52.855039 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-461b51d2-1ccf-4e32-9d60-91960ee91407 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:53.086677 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-461b51d2-1ccf-4e32-9d60-91960ee91407 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:53.103139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-461b51d2-1ccf-4e32-9d60-91960ee91407 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:53.105582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-461b51d2-1ccf-4e32-9d60-91960ee91407 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:53.109655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-461b51d2-1ccf-4e32-9d60-91960ee91407 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1343 microversion: 2.20 time: 0.273752 Apr 16 16:54:53.109904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 367/700] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:52 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1343 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:54:54.137570 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1b09a691-171b-4cae-b657-05cb4d3743b9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:54.139651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1b09a691-171b-4cae-b657-05cb4d3743b9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:54.155750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b09a691-171b-4cae-b657-05cb4d3743b9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:54.156266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b09a691-171b-4cae-b657-05cb4d3743b9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:54.157160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b09a691-171b-4cae-b657-05cb4d3743b9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:54.157684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b09a691-171b-4cae-b657-05cb4d3743b9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:54.710600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9f724977-e197-4b6f-b448-5cc42e7f0015 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2102634327"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:54.711636 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9f724977-e197-4b6f-b448-5cc42e7f0015 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:54.734172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f724977-e197-4b6f-b448-5cc42e7f0015 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:54.736781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f724977-e197-4b6f-b448-5cc42e7f0015 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:54.738034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f724977-e197-4b6f-b448-5cc42e7f0015 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:54.738822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f724977-e197-4b6f-b448-5cc42e7f0015 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:54.828563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1b09a691-171b-4cae-b657-05cb4d3743b9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:54.842551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1b09a691-171b-4cae-b657-05cb4d3743b9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:54.845419 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1b09a691-171b-4cae-b657-05cb4d3743b9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:54.847832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1b09a691-171b-4cae-b657-05cb4d3743b9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1411 microversion: 2.20 time: 0.717240 Apr 16 16:54:54.865916 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 334/701] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:54 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1411 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:54:55.106623 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.network.security_group_api [None req-9f724977-e197-4b6f-b448-5cc42e7f0015 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Adding security group dbdcd3e8-dd73-4ca1-915f-d3cd574a0d1b to port 48feea5a-19f4-4f16-80f8-5166404c8b45 Apr 16 16:54:55.874239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ae7eac5b-699c-45e0-86ff-6e8f3b9a28f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:55.875708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ae7eac5b-699c-45e0-86ff-6e8f3b9a28f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:55.895566 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae7eac5b-699c-45e0-86ff-6e8f3b9a28f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:55.896331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae7eac5b-699c-45e0-86ff-6e8f3b9a28f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:55.899090 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae7eac5b-699c-45e0-86ff-6e8f3b9a28f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:55.900134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae7eac5b-699c-45e0-86ff-6e8f3b9a28f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:57.084133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ae7eac5b-699c-45e0-86ff-6e8f3b9a28f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:57.099449 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ae7eac5b-699c-45e0-86ff-6e8f3b9a28f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:57.111068 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ae7eac5b-699c-45e0-86ff-6e8f3b9a28f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:57.112640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ae7eac5b-699c-45e0-86ff-6e8f3b9a28f6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1411 microversion: 2.20 time: 1.247177 Apr 16 16:54:57.115082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 335/702] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:55 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1411 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:54:57.243234 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9f724977-e197-4b6f-b448-5cc42e7f0015 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "POST /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/action" status: 202 len: 0 microversion: 2.1 time: 2.548499 Apr 16 16:54:57.248307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 368/703] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:54:54 2021] POST /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/action => generated 0 bytes in 2555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:54:57.254394 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-3aba4837-9c2f-499d-82ce-39d35dbc71d6 req-6481b847-eab4-486e-bcb8-98fb818840ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f254d3-c0d6-4c32-897b-e19f47934010", "tag": "48feea5a-19f4-4f16-80f8-5166404c8b45"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:57.255091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-96e1d454-dd43-4095-ad2e-5973fee70efb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:57.255774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-96e1d454-dd43-4095-ad2e-5973fee70efb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:57.257802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:54:57.257802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:54:57.272882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-96e1d454-dd43-4095-ad2e-5973fee70efb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:57.273262 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-96e1d454-dd43-4095-ad2e-5973fee70efb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:57.274426 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-96e1d454-dd43-4095-ad2e-5973fee70efb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:57.275844 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-96e1d454-dd43-4095-ad2e-5973fee70efb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:57.290079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-3aba4837-9c2f-499d-82ce-39d35dbc71d6 req-6481b847-eab4-486e-bcb8-98fb818840ca service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:57.295730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-3aba4837-9c2f-499d-82ce-39d35dbc71d6 req-6481b847-eab4-486e-bcb8-98fb818840ca service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:57.354362 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-3aba4837-9c2f-499d-82ce-39d35dbc71d6 req-6481b847-eab4-486e-bcb8-98fb818840ca service nova] Creating event network-changed:48feea5a-19f4-4f16-80f8-5166404c8b45 for instance a0f254d3-c0d6-4c32-897b-e19f47934010 on hv-cinder-73362 Apr 16 16:54:57.384779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-3aba4837-9c2f-499d-82ce-39d35dbc71d6 req-6481b847-eab4-486e-bcb8-98fb818840ca service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135942 Apr 16 16:54:57.386044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 336/704] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:54:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:54:58.020283 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-96e1d454-dd43-4095-ad2e-5973fee70efb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:58.030807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-96e1d454-dd43-4095-ad2e-5973fee70efb tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1761 microversion: 2.1 time: 0.780717 Apr 16 16:54:58.033025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 369/705] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:54:57 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1761 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:54:58.146517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0d2543d7-4874-4995-a95c-6fe29575ee21 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:58.148488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0d2543d7-4874-4995-a95c-6fe29575ee21 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:58.164461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d2543d7-4874-4995-a95c-6fe29575ee21 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:58.165003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d2543d7-4874-4995-a95c-6fe29575ee21 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:58.165865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d2543d7-4874-4995-a95c-6fe29575ee21 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:58.166374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d2543d7-4874-4995-a95c-6fe29575ee21 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:58.602557 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0d2543d7-4874-4995-a95c-6fe29575ee21 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:58.614948 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0d2543d7-4874-4995-a95c-6fe29575ee21 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:58.620194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0d2543d7-4874-4995-a95c-6fe29575ee21 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:54:58.621440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0d2543d7-4874-4995-a95c-6fe29575ee21 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1411 microversion: 2.20 time: 0.481637 Apr 16 16:54:58.622069 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 337/706] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:58 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1411 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:54:59.422268 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-34b27b57-401f-423d-83c6-708de5e913b4 req-17c092fc-4d6e-48e9-b9dd-55b716396e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a606efe-c285-436f-9d27-d09708bc4564", "tag": "aef9925c-8048-4095-a618-0d55f10b32a1"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:54:59.424908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:54:59.424908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:54:59.435272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-34b27b57-401f-423d-83c6-708de5e913b4 req-17c092fc-4d6e-48e9-b9dd-55b716396e06 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:59.436206 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-34b27b57-401f-423d-83c6-708de5e913b4 req-17c092fc-4d6e-48e9-b9dd-55b716396e06 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:59.463794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-34b27b57-401f-423d-83c6-708de5e913b4 req-17c092fc-4d6e-48e9-b9dd-55b716396e06 service nova] Creating event network-changed:aef9925c-8048-4095-a618-0d55f10b32a1 for instance 4a606efe-c285-436f-9d27-d09708bc4564 on hv-cinder-73362 Apr 16 16:54:59.471424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-34b27b57-401f-423d-83c6-708de5e913b4 req-17c092fc-4d6e-48e9-b9dd-55b716396e06 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053793 Apr 16 16:54:59.472371 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 370/707] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:54:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:54:59.644088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ee98447b-84d5-45bc-a003-587b60f773fc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:54:59.645419 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ee98447b-84d5-45bc-a003-587b60f773fc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:54:59.653999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee98447b-84d5-45bc-a003-587b60f773fc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:59.654649 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee98447b-84d5-45bc-a003-587b60f773fc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:54:59.655829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee98447b-84d5-45bc-a003-587b60f773fc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:54:59.656655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee98447b-84d5-45bc-a003-587b60f773fc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:00.087525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ee98447b-84d5-45bc-a003-587b60f773fc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:00.102485 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ee98447b-84d5-45bc-a003-587b60f773fc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:00.104587 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ee98447b-84d5-45bc-a003-587b60f773fc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:00.105874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ee98447b-84d5-45bc-a003-587b60f773fc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1411 microversion: 2.20 time: 0.467850 Apr 16 16:55:00.106829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 338/708] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:54:59 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1411 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:55:01.137384 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b99a993f-d311-4ae4-893c-2d34fe287a93 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:01.138180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b99a993f-d311-4ae4-893c-2d34fe287a93 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:01.155561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b99a993f-d311-4ae4-893c-2d34fe287a93 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:01.156426 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b99a993f-d311-4ae4-893c-2d34fe287a93 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:01.159152 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b99a993f-d311-4ae4-893c-2d34fe287a93 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:01.160104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b99a993f-d311-4ae4-893c-2d34fe287a93 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:01.529169 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b99a993f-d311-4ae4-893c-2d34fe287a93 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:01.545297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b99a993f-d311-4ae4-893c-2d34fe287a93 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:01.547331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b99a993f-d311-4ae4-893c-2d34fe287a93 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:01.549216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b99a993f-d311-4ae4-893c-2d34fe287a93 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1411 microversion: 2.20 time: 0.423496 Apr 16 16:55:01.549891 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 371/709] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:55:01 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1411 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:55:02.569368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e2b3cb97-8f91-4cc7-b840-4d93981e3eb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:02.570009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e2b3cb97-8f91-4cc7-b840-4d93981e3eb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:02.579834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2b3cb97-8f91-4cc7-b840-4d93981e3eb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:02.580814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2b3cb97-8f91-4cc7-b840-4d93981e3eb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:02.581637 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2b3cb97-8f91-4cc7-b840-4d93981e3eb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:02.582380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2b3cb97-8f91-4cc7-b840-4d93981e3eb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:02.862811 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e2b3cb97-8f91-4cc7-b840-4d93981e3eb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:02.875184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e2b3cb97-8f91-4cc7-b840-4d93981e3eb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:02.877338 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e2b3cb97-8f91-4cc7-b840-4d93981e3eb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:02.878648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e2b3cb97-8f91-4cc7-b840-4d93981e3eb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1411 microversion: 2.20 time: 0.313419 Apr 16 16:55:02.879305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 339/710] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:55:02 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1411 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:55:03.901389 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7b500843-ee14-479f-9d07-b61fccfadcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:03.902068 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7b500843-ee14-479f-9d07-b61fccfadcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:03.912888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b500843-ee14-479f-9d07-b61fccfadcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:03.913408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b500843-ee14-479f-9d07-b61fccfadcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:03.914330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b500843-ee14-479f-9d07-b61fccfadcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:03.914835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b500843-ee14-479f-9d07-b61fccfadcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:04.433463 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7b500843-ee14-479f-9d07-b61fccfadcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:04.445544 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7b500843-ee14-479f-9d07-b61fccfadcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:04.447416 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7b500843-ee14-479f-9d07-b61fccfadcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:04.448528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7b500843-ee14-479f-9d07-b61fccfadcc4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1411 microversion: 2.20 time: 0.552289 Apr 16 16:55:04.449170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 372/711] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:55:03 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1411 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:55:04.651990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-2077c92e-1138-445b-9650-3b66e113b12f req-65774d1f-c9dd-423c-bfaf-ed35cc00967c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a606efe-c285-436f-9d27-d09708bc4564", "name": "network-vif-plugged", "status": "completed", "tag": "aef9925c-8048-4095-a618-0d55f10b32a1"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:04.653905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:55:04.653905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:55:04.665476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-2077c92e-1138-445b-9650-3b66e113b12f req-65774d1f-c9dd-423c-bfaf-ed35cc00967c service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:04.665981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-2077c92e-1138-445b-9650-3b66e113b12f req-65774d1f-c9dd-423c-bfaf-ed35cc00967c service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:04.686509 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-2077c92e-1138-445b-9650-3b66e113b12f req-65774d1f-c9dd-423c-bfaf-ed35cc00967c service nova] Creating event network-vif-plugged:aef9925c-8048-4095-a618-0d55f10b32a1 for instance 4a606efe-c285-436f-9d27-d09708bc4564 on hv-cinder-73362 Apr 16 16:55:04.692221 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-2077c92e-1138-445b-9650-3b66e113b12f req-65774d1f-c9dd-423c-bfaf-ed35cc00967c service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044594 Apr 16 16:55:04.693100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 340/712] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:55:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:55:05.473235 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-efdfcfc7-5d14-4515-a061-927bba8bcfc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:05.473878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-efdfcfc7-5d14-4515-a061-927bba8bcfc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:05.482215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-efdfcfc7-5d14-4515-a061-927bba8bcfc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:05.482783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-efdfcfc7-5d14-4515-a061-927bba8bcfc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:05.483687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-efdfcfc7-5d14-4515-a061-927bba8bcfc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:05.484429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-efdfcfc7-5d14-4515-a061-927bba8bcfc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:05.750700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-efdfcfc7-5d14-4515-a061-927bba8bcfc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:05.767146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-efdfcfc7-5d14-4515-a061-927bba8bcfc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:05.769079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-efdfcfc7-5d14-4515-a061-927bba8bcfc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:05.770520 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-efdfcfc7-5d14-4515-a061-927bba8bcfc8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1411 microversion: 2.20 time: 0.301794 Apr 16 16:55:05.771155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 373/713] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:55:05 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1411 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:55:06.792477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4540fb9c-e5bb-440a-bbbd-2f1493f678d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:06.793151 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4540fb9c-e5bb-440a-bbbd-2f1493f678d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:06.803380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4540fb9c-e5bb-440a-bbbd-2f1493f678d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:06.804106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4540fb9c-e5bb-440a-bbbd-2f1493f678d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:06.805016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4540fb9c-e5bb-440a-bbbd-2f1493f678d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:06.805519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4540fb9c-e5bb-440a-bbbd-2f1493f678d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:07.084332 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4540fb9c-e5bb-440a-bbbd-2f1493f678d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:07.096166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4540fb9c-e5bb-440a-bbbd-2f1493f678d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:07.098411 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4540fb9c-e5bb-440a-bbbd-2f1493f678d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:07.100406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4540fb9c-e5bb-440a-bbbd-2f1493f678d9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1603 microversion: 2.20 time: 0.312972 Apr 16 16:55:07.101052 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 341/714] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:55:06 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1603 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:55:07.129209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5f388dea-01bb-4935-839e-a8c584be6333 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:07.130155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5f388dea-01bb-4935-839e-a8c584be6333 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:07.146098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f388dea-01bb-4935-839e-a8c584be6333 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:07.147016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f388dea-01bb-4935-839e-a8c584be6333 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:07.148875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f388dea-01bb-4935-839e-a8c584be6333 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:07.149858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f388dea-01bb-4935-839e-a8c584be6333 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:07.379966 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5f388dea-01bb-4935-839e-a8c584be6333 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.259684 Apr 16 16:55:07.381343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 374/715] 10.222.0.103 () {60 vars in 1311 bytes} [Fri Apr 16 16:55:07 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/os-interface => generated 284 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:55:08.944380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5c7335a6-4db6-47b2-ba3d-8fd4a39b2b5d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:08.945073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5c7335a6-4db6-47b2-ba3d-8fd4a39b2b5d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:08.957583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c7335a6-4db6-47b2-ba3d-8fd4a39b2b5d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:08.958132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c7335a6-4db6-47b2-ba3d-8fd4a39b2b5d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:08.959099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c7335a6-4db6-47b2-ba3d-8fd4a39b2b5d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:08.959622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c7335a6-4db6-47b2-ba3d-8fd4a39b2b5d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:09.050425 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-5c7335a6-4db6-47b2-ba3d-8fd4a39b2b5d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lazy-loading 'flavor' on Instance uuid e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:55:09.257079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5c7335a6-4db6-47b2-ba3d-8fd4a39b2b5d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "POST /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5/action" status: 202 len: 0 microversion: 2.1 time: 0.317451 Apr 16 16:55:09.257983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 342/716] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:55:08 2021] POST /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:09.270440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fb319a6a-8402-45ca-a531-783c59915b7f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:09.271135 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fb319a6a-8402-45ca-a531-783c59915b7f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:09.272883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f856e1b0-7edb-48d5-87f1-6aa59ad03289 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:09.274352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f856e1b0-7edb-48d5-87f1-6aa59ad03289 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:09.288380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f856e1b0-7edb-48d5-87f1-6aa59ad03289 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:09.289815 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb319a6a-8402-45ca-a531-783c59915b7f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:09.289965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f856e1b0-7edb-48d5-87f1-6aa59ad03289 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:09.290361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb319a6a-8402-45ca-a531-783c59915b7f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:09.291224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb319a6a-8402-45ca-a531-783c59915b7f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:09.291599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f856e1b0-7edb-48d5-87f1-6aa59ad03289 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:09.291707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb319a6a-8402-45ca-a531-783c59915b7f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:09.292581 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f856e1b0-7edb-48d5-87f1-6aa59ad03289 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:09.477684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f856e1b0-7edb-48d5-87f1-6aa59ad03289 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 0.219510 Apr 16 16:55:09.480582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 375/717] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:09 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:09.618986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fb319a6a-8402-45ca-a531-783c59915b7f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:09.636114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fb319a6a-8402-45ca-a531-783c59915b7f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.370761 Apr 16 16:55:09.637314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 343/718] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:09 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:09.733322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-7188ab16-5645-4936-ac51-08b3dea0df81 req-4d30c705-4300-4d3a-904b-026b0193d616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a606efe-c285-436f-9d27-d09708bc4564", "tag": "aef9925c-8048-4095-a618-0d55f10b32a1"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:09.735867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:55:09.735867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:55:09.746582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-7188ab16-5645-4936-ac51-08b3dea0df81 req-4d30c705-4300-4d3a-904b-026b0193d616 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:09.747426 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-7188ab16-5645-4936-ac51-08b3dea0df81 req-4d30c705-4300-4d3a-904b-026b0193d616 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:09.767059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-7188ab16-5645-4936-ac51-08b3dea0df81 req-4d30c705-4300-4d3a-904b-026b0193d616 service nova] Creating event network-changed:aef9925c-8048-4095-a618-0d55f10b32a1 for instance 4a606efe-c285-436f-9d27-d09708bc4564 on hv-cinder-73362 Apr 16 16:55:09.775325 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-7188ab16-5645-4936-ac51-08b3dea0df81 req-4d30c705-4300-4d3a-904b-026b0193d616 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292223 Apr 16 16:55:09.776309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 376/719] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:55:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:55:10.494961 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1c24b1fe-6101-4ccf-b57e-fda9cd9525bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:10.497149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1c24b1fe-6101-4ccf-b57e-fda9cd9525bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:10.519479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c24b1fe-6101-4ccf-b57e-fda9cd9525bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:10.520336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c24b1fe-6101-4ccf-b57e-fda9cd9525bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:10.521387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c24b1fe-6101-4ccf-b57e-fda9cd9525bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:10.521894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c24b1fe-6101-4ccf-b57e-fda9cd9525bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:10.666617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ac9c584b-7bf6-4426-b96b-d0007e7483c2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:10.667862 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ac9c584b-7bf6-4426-b96b-d0007e7483c2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:10.680732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ac9c584b-7bf6-4426-b96b-d0007e7483c2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:10.681377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ac9c584b-7bf6-4426-b96b-d0007e7483c2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:10.683603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ac9c584b-7bf6-4426-b96b-d0007e7483c2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:10.683603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ac9c584b-7bf6-4426-b96b-d0007e7483c2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:10.694456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1c24b1fe-6101-4ccf-b57e-fda9cd9525bc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 0.203259 Apr 16 16:55:10.695636 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 344/720] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:10 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:11.337238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ac9c584b-7bf6-4426-b96b-d0007e7483c2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:11.348715 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ac9c584b-7bf6-4426-b96b-d0007e7483c2 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.694220 Apr 16 16:55:11.350741 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 377/721] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:10 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:11.708899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-81451731-6749-4615-bf4b-08b70072c476 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:11.709892 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-81451731-6749-4615-bf4b-08b70072c476 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:11.724469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-81451731-6749-4615-bf4b-08b70072c476 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:11.724897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-81451731-6749-4615-bf4b-08b70072c476 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:11.725746 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-81451731-6749-4615-bf4b-08b70072c476 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:11.726226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-81451731-6749-4615-bf4b-08b70072c476 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:11.875542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-81451731-6749-4615-bf4b-08b70072c476 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 0.171671 Apr 16 16:55:11.876438 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 345/722] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:11 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:12.370907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-749ff549-cc99-4920-9863-09a16cd7b715 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:12.371897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-749ff549-cc99-4920-9863-09a16cd7b715 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:12.383974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-749ff549-cc99-4920-9863-09a16cd7b715 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:12.384625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-749ff549-cc99-4920-9863-09a16cd7b715 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:12.385747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-749ff549-cc99-4920-9863-09a16cd7b715 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:12.386407 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-749ff549-cc99-4920-9863-09a16cd7b715 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:12.616019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-749ff549-cc99-4920-9863-09a16cd7b715 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:12.625413 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-749ff549-cc99-4920-9863-09a16cd7b715 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.261425 Apr 16 16:55:12.627051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 378/723] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:12 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:12.889041 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4de36c7f-6dc3-4165-9a4f-10e721f5f336 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:12.890113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4de36c7f-6dc3-4165-9a4f-10e721f5f336 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:12.901009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4de36c7f-6dc3-4165-9a4f-10e721f5f336 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:12.901512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4de36c7f-6dc3-4165-9a4f-10e721f5f336 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:12.902473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4de36c7f-6dc3-4165-9a4f-10e721f5f336 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:12.903051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4de36c7f-6dc3-4165-9a4f-10e721f5f336 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:13.646978 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b7dbcfef-7a81-445c-8be0-baaedb22ccf4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:13.647751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b7dbcfef-7a81-445c-8be0-baaedb22ccf4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:13.656646 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7dbcfef-7a81-445c-8be0-baaedb22ccf4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:13.657184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7dbcfef-7a81-445c-8be0-baaedb22ccf4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:13.658088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7dbcfef-7a81-445c-8be0-baaedb22ccf4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:13.658653 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b7dbcfef-7a81-445c-8be0-baaedb22ccf4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:13.990826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b7dbcfef-7a81-445c-8be0-baaedb22ccf4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:14.003037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b7dbcfef-7a81-445c-8be0-baaedb22ccf4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.361382 Apr 16 16:55:14.003888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 379/724] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:13 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:15.049141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b4435db0-f659-43d9-b3de-86e5d917cb7a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:15.050396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b4435db0-f659-43d9-b3de-86e5d917cb7a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:15.066074 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4435db0-f659-43d9-b3de-86e5d917cb7a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:15.067197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4435db0-f659-43d9-b3de-86e5d917cb7a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:15.068694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4435db0-f659-43d9-b3de-86e5d917cb7a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:15.069643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b4435db0-f659-43d9-b3de-86e5d917cb7a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:15.308333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4de36c7f-6dc3-4165-9a4f-10e721f5f336 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 2.423368 Apr 16 16:55:15.312437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 346/725] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:12 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 2426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:15.376278 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b4435db0-f659-43d9-b3de-86e5d917cb7a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:15.386691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b4435db0-f659-43d9-b3de-86e5d917cb7a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.364000 Apr 16 16:55:15.387331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 380/726] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:15 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:16.324021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c1a2382f-1d64-4780-ada9-fbc8f3afd01a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:16.325344 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c1a2382f-1d64-4780-ada9-fbc8f3afd01a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:16.335630 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1a2382f-1d64-4780-ada9-fbc8f3afd01a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:16.336126 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1a2382f-1d64-4780-ada9-fbc8f3afd01a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:16.336980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1a2382f-1d64-4780-ada9-fbc8f3afd01a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:16.337461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1a2382f-1d64-4780-ada9-fbc8f3afd01a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:16.410508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0679499c-d824-47c2-8574-02a6256b2b32 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:16.413415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0679499c-d824-47c2-8574-02a6256b2b32 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:16.426062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0679499c-d824-47c2-8574-02a6256b2b32 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:16.426607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0679499c-d824-47c2-8574-02a6256b2b32 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:16.427497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0679499c-d824-47c2-8574-02a6256b2b32 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:16.427995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0679499c-d824-47c2-8574-02a6256b2b32 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:16.450727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c1a2382f-1d64-4780-ada9-fbc8f3afd01a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 0.131488 Apr 16 16:55:16.451856 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 347/727] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:16 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:16.705879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0679499c-d824-47c2-8574-02a6256b2b32 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:16.720242 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0679499c-d824-47c2-8574-02a6256b2b32 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.316108 Apr 16 16:55:16.720242 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 381/728] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:16 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:16.971978 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-627768e1-3c1a-4a7a-b072-f613cae486f4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:16.973153 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-627768e1-3c1a-4a7a-b072-f613cae486f4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:16.988872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-627768e1-3c1a-4a7a-b072-f613cae486f4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:16.989769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-627768e1-3c1a-4a7a-b072-f613cae486f4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:16.991274 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-627768e1-3c1a-4a7a-b072-f613cae486f4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:16.992165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-627768e1-3c1a-4a7a-b072-f613cae486f4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:17.096304 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-627768e1-3c1a-4a7a-b072-f613cae486f4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Going to try to terminate instance {{(pid=99399) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:55:17.246905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-627768e1-3c1a-4a7a-b072-f613cae486f4 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "DELETE /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 204 len: 0 microversion: 2.1 time: 0.283058 Apr 16 16:55:17.248439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 348/729] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:55:16 2021] DELETE /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:55:17.260121 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fdb8f87e-0e23-4a83-9710-a172e853c7db tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:17.261575 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fdb8f87e-0e23-4a83-9710-a172e853c7db tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:17.273851 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdb8f87e-0e23-4a83-9710-a172e853c7db tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:17.276540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdb8f87e-0e23-4a83-9710-a172e853c7db tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:17.276540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdb8f87e-0e23-4a83-9710-a172e853c7db tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:17.276540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdb8f87e-0e23-4a83-9710-a172e853c7db tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:17.468515 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f507f0f2-5347-4436-a48a-9de7f093a1aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:17.470697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f507f0f2-5347-4436-a48a-9de7f093a1aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:17.479086 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f507f0f2-5347-4436-a48a-9de7f093a1aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:17.479586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f507f0f2-5347-4436-a48a-9de7f093a1aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:17.480531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f507f0f2-5347-4436-a48a-9de7f093a1aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:17.481014 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f507f0f2-5347-4436-a48a-9de7f093a1aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:17.605322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fdb8f87e-0e23-4a83-9710-a172e853c7db tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:17.615534 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fdb8f87e-0e23-4a83-9710-a172e853c7db tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1678 microversion: 2.1 time: 0.359934 Apr 16 16:55:17.616369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 382/730] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:17 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1678 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:17.620085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f507f0f2-5347-4436-a48a-9de7f093a1aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 0.157281 Apr 16 16:55:17.620908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 349/731] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:17 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:17.740124 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cfba025a-9c2b-40fc-bd1f-d3733f63b777 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:17.740795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cfba025a-9c2b-40fc-bd1f-d3733f63b777 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:17.749473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cfba025a-9c2b-40fc-bd1f-d3733f63b777 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:17.749985 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cfba025a-9c2b-40fc-bd1f-d3733f63b777 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:17.751303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cfba025a-9c2b-40fc-bd1f-d3733f63b777 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:17.751529 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cfba025a-9c2b-40fc-bd1f-d3733f63b777 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:17.987127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cfba025a-9c2b-40fc-bd1f-d3733f63b777 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:17.996891 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cfba025a-9c2b-40fc-bd1f-d3733f63b777 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.261083 Apr 16 16:55:17.997543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 383/732] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:17 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:18.635534 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0b2410d5-3488-43b9-807d-c35a38832193 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:18.636883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0b2410d5-3488-43b9-807d-c35a38832193 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:18.638832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d9dd9c91-69b0-4d00-8e8d-663c0a85dd0b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:18.639510 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d9dd9c91-69b0-4d00-8e8d-663c0a85dd0b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:18.648141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b2410d5-3488-43b9-807d-c35a38832193 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:18.648640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d9dd9c91-69b0-4d00-8e8d-663c0a85dd0b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:18.648934 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b2410d5-3488-43b9-807d-c35a38832193 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:18.649045 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d9dd9c91-69b0-4d00-8e8d-663c0a85dd0b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:18.649776 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b2410d5-3488-43b9-807d-c35a38832193 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:18.649883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d9dd9c91-69b0-4d00-8e8d-663c0a85dd0b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:18.650265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d9dd9c91-69b0-4d00-8e8d-663c0a85dd0b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:18.650397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0b2410d5-3488-43b9-807d-c35a38832193 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:18.769032 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0b2410d5-3488-43b9-807d-c35a38832193 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 0.138338 Apr 16 16:55:18.769715 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 350/733] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:18 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:18.927451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d9dd9c91-69b0-4d00-8e8d-663c0a85dd0b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:18.943445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d9dd9c91-69b0-4d00-8e8d-663c0a85dd0b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1678 microversion: 2.1 time: 0.307997 Apr 16 16:55:18.944593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 384/734] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:18 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1678 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:19.019833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b67f918b-60ed-4be9-aad2-f64312b5a767 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:19.020622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b67f918b-60ed-4be9-aad2-f64312b5a767 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:19.045818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b67f918b-60ed-4be9-aad2-f64312b5a767 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:19.048000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b67f918b-60ed-4be9-aad2-f64312b5a767 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:19.050104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b67f918b-60ed-4be9-aad2-f64312b5a767 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:19.051150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b67f918b-60ed-4be9-aad2-f64312b5a767 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:19.289516 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b67f918b-60ed-4be9-aad2-f64312b5a767 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:19.300392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b67f918b-60ed-4be9-aad2-f64312b5a767 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.287163 Apr 16 16:55:19.301047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 351/735] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:19 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:19.784262 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b88959a4-896a-4fea-b000-130f0bba017d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:19.785592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b88959a4-896a-4fea-b000-130f0bba017d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:19.796724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b88959a4-896a-4fea-b000-130f0bba017d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:19.797229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b88959a4-896a-4fea-b000-130f0bba017d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:19.798733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b88959a4-896a-4fea-b000-130f0bba017d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:19.799311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b88959a4-896a-4fea-b000-130f0bba017d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:19.934790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b88959a4-896a-4fea-b000-130f0bba017d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 0.156928 Apr 16 16:55:19.935423 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 385/736] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:19 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:19.963426 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5c1c4541-0c38-4ac7-b190-59f2ce2b6b66 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:19.964215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5c1c4541-0c38-4ac7-b190-59f2ce2b6b66 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:19.973900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c1c4541-0c38-4ac7-b190-59f2ce2b6b66 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:19.974757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c1c4541-0c38-4ac7-b190-59f2ce2b6b66 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:19.976296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c1c4541-0c38-4ac7-b190-59f2ce2b6b66 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:19.977244 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c1c4541-0c38-4ac7-b190-59f2ce2b6b66 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:20.325778 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5e5cb617-089b-4503-b4d1-458644f94ec9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:20.327785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5e5cb617-089b-4503-b4d1-458644f94ec9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:20.344379 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5e5cb617-089b-4503-b4d1-458644f94ec9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:20.345338 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5e5cb617-089b-4503-b4d1-458644f94ec9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:20.346989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5e5cb617-089b-4503-b4d1-458644f94ec9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:20.347988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5e5cb617-089b-4503-b4d1-458644f94ec9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:20.483497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5c1c4541-0c38-4ac7-b190-59f2ce2b6b66 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:20.506164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5c1c4541-0c38-4ac7-b190-59f2ce2b6b66 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1678 microversion: 2.1 time: 0.546590 Apr 16 16:55:20.507971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 352/737] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:19 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1678 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:20.924896 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5e5cb617-089b-4503-b4d1-458644f94ec9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:20.937055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5e5cb617-089b-4503-b4d1-458644f94ec9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.620425 Apr 16 16:55:20.937785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 386/738] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:20 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:20.949311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-390ae7a2-a1bb-4529-9df9-4ca4a3ae9728 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:20.950896 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-390ae7a2-a1bb-4529-9df9-4ca4a3ae9728 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:20.960027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-390ae7a2-a1bb-4529-9df9-4ca4a3ae9728 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:20.960543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-390ae7a2-a1bb-4529-9df9-4ca4a3ae9728 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:20.961387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-390ae7a2-a1bb-4529-9df9-4ca4a3ae9728 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:20.961875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-390ae7a2-a1bb-4529-9df9-4ca4a3ae9728 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:21.085942 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-390ae7a2-a1bb-4529-9df9-4ca4a3ae9728 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 0.141527 Apr 16 16:55:21.087048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 353/739] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:20 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:21.535994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-808bf8bb-a0d5-4d82-b934-04137fd8e770 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:21.536583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-808bf8bb-a0d5-4d82-b934-04137fd8e770 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:21.549872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-808bf8bb-a0d5-4d82-b934-04137fd8e770 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:21.549872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-808bf8bb-a0d5-4d82-b934-04137fd8e770 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:21.549872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-808bf8bb-a0d5-4d82-b934-04137fd8e770 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:21.549872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-808bf8bb-a0d5-4d82-b934-04137fd8e770 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:21.741369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-808bf8bb-a0d5-4d82-b934-04137fd8e770 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:21.752368 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-808bf8bb-a0d5-4d82-b934-04137fd8e770 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1610 microversion: 2.1 time: 0.220886 Apr 16 16:55:21.753357 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 387/740] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:21 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1610 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:21.958700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9af51887-3d75-4a02-88c4-7fc68c18079a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:21.960223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9af51887-3d75-4a02-88c4-7fc68c18079a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:21.976277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9af51887-3d75-4a02-88c4-7fc68c18079a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:21.977335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9af51887-3d75-4a02-88c4-7fc68c18079a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:21.978835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9af51887-3d75-4a02-88c4-7fc68c18079a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:21.979530 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9af51887-3d75-4a02-88c4-7fc68c18079a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:22.100650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9137fd17-cc03-45ef-8382-c27021f87f95 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:22.101747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9137fd17-cc03-45ef-8382-c27021f87f95 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:22.111772 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9137fd17-cc03-45ef-8382-c27021f87f95 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:22.112285 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9137fd17-cc03-45ef-8382-c27021f87f95 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:22.113137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9137fd17-cc03-45ef-8382-c27021f87f95 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:22.113793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9137fd17-cc03-45ef-8382-c27021f87f95 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:22.508902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9af51887-3d75-4a02-88c4-7fc68c18079a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:22.519761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9af51887-3d75-4a02-88c4-7fc68c18079a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.567582 Apr 16 16:55:22.520409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 354/741] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:21 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:22.525880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-7d48cfdb-3632-4734-b518-1d44620036c1 req-bda13d58-18d3-4a9f-b0bb-b8b86dd79870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e97f89-9724-46b1-8d71-56732a4b3c27", "name": "network-vif-deleted", "tag": "d2eed23b-d045-4095-8b56-18eb78329917"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:22.527641 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:55:22.527641 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:55:22.536910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-7d48cfdb-3632-4734-b518-1d44620036c1 req-bda13d58-18d3-4a9f-b0bb-b8b86dd79870 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:22.537409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-7d48cfdb-3632-4734-b518-1d44620036c1 req-bda13d58-18d3-4a9f-b0bb-b8b86dd79870 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:22.557060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-7d48cfdb-3632-4734-b518-1d44620036c1 req-bda13d58-18d3-4a9f-b0bb-b8b86dd79870 service nova] Creating event network-vif-deleted:d2eed23b-d045-4095-8b56-18eb78329917 for instance 22e97f89-9724-46b1-8d71-56732a4b3c27 on hv-cinder-73362 Apr 16 16:55:22.562663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-7d48cfdb-3632-4734-b518-1d44620036c1 req-bda13d58-18d3-4a9f-b0bb-b8b86dd79870 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040872 Apr 16 16:55:22.564138 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 355/742] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:55:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:55:22.774034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-65d368a9-7553-4023-acfd-c9c7b74b3bfb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:22.774849 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-65d368a9-7553-4023-acfd-c9c7b74b3bfb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:22.786954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-65d368a9-7553-4023-acfd-c9c7b74b3bfb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:22.787460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-65d368a9-7553-4023-acfd-c9c7b74b3bfb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:22.788369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-65d368a9-7553-4023-acfd-c9c7b74b3bfb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:22.788904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-65d368a9-7553-4023-acfd-c9c7b74b3bfb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:22.950784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-65d368a9-7553-4023-acfd-c9c7b74b3bfb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:22.964263 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-65d368a9-7553-4023-acfd-c9c7b74b3bfb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1610 microversion: 2.1 time: 0.196344 Apr 16 16:55:22.965045 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 356/743] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:22 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1610 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:23.541694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-049a7ce3-2c64-4771-b6cb-2554a3ca1794 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:23.542432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-049a7ce3-2c64-4771-b6cb-2554a3ca1794 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:23.553126 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-049a7ce3-2c64-4771-b6cb-2554a3ca1794 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:23.553628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-049a7ce3-2c64-4771-b6cb-2554a3ca1794 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:23.554562 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-049a7ce3-2c64-4771-b6cb-2554a3ca1794 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:23.555061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-049a7ce3-2c64-4771-b6cb-2554a3ca1794 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:24.082919 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-049a7ce3-2c64-4771-b6cb-2554a3ca1794 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:24.092628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-049a7ce3-2c64-4771-b6cb-2554a3ca1794 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.555223 Apr 16 16:55:24.093290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 357/744] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:23 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:24.099002 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-582b7f81-89a1-4821-be24-9976331d3359 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:24.099698 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-582b7f81-89a1-4821-be24-9976331d3359 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:24.108123 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-582b7f81-89a1-4821-be24-9976331d3359 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:24.108634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-582b7f81-89a1-4821-be24-9976331d3359 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:24.109515 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-582b7f81-89a1-4821-be24-9976331d3359 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:24.111395 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-582b7f81-89a1-4821-be24-9976331d3359 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:24.258186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-582b7f81-89a1-4821-be24-9976331d3359 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:24.267636 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-582b7f81-89a1-4821-be24-9976331d3359 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1610 microversion: 2.1 time: 0.173270 Apr 16 16:55:24.268355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 358/745] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:24 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1610 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:24.833651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9137fd17-cc03-45ef-8382-c27021f87f95 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 2.737389 Apr 16 16:55:24.834626 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 388/746] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:22 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 2741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:25.122390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d482ebe2-1060-48b5-b706-370771a61761 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:25.123053 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d482ebe2-1060-48b5-b706-370771a61761 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:25.132099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d482ebe2-1060-48b5-b706-370771a61761 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:25.132607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d482ebe2-1060-48b5-b706-370771a61761 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:25.133449 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d482ebe2-1060-48b5-b706-370771a61761 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:25.133944 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d482ebe2-1060-48b5-b706-370771a61761 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:25.287936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:25.288711 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:25.298986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:25.299474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:25.300527 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:25.301018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:25.440291 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:25.440891 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:25.441551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lazy-loading 'fault' on Instance uuid 22e97f89-9724-46b1-8d71-56732a4b3c27 {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:55:25.455607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d482ebe2-1060-48b5-b706-370771a61761 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:25.482928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d482ebe2-1060-48b5-b706-370771a61761 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.363975 Apr 16 16:55:25.484536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 359/747] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:25 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:25.534995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:25.544774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9dab21c0-da6e-4197-ad48-e4d1100c3ecf tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 200 len: 1331 microversion: 2.1 time: 0.261376 Apr 16 16:55:25.545913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 389/748] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:25 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 1331 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:25.848517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-09cf594a-5331-4d44-a875-47e7655eee6b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:25.849776 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-09cf594a-5331-4d44-a875-47e7655eee6b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:25.859432 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-09cf594a-5331-4d44-a875-47e7655eee6b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:25.860187 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-09cf594a-5331-4d44-a875-47e7655eee6b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:25.861099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-09cf594a-5331-4d44-a875-47e7655eee6b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:25.861600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-09cf594a-5331-4d44-a875-47e7655eee6b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:25.967127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-09cf594a-5331-4d44-a875-47e7655eee6b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 0.124478 Apr 16 16:55:25.968054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 360/749] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:25 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:26.512516 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c6463bf6-75d8-4531-af11-71270ed8981b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:26.515721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c6463bf6-75d8-4531-af11-71270ed8981b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:26.528319 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c6463bf6-75d8-4531-af11-71270ed8981b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:26.529181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c6463bf6-75d8-4531-af11-71270ed8981b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:26.530720 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c6463bf6-75d8-4531-af11-71270ed8981b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:26.531305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c6463bf6-75d8-4531-af11-71270ed8981b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:26.568215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d258fcbb-49bb-4833-968f-238ee75f7283 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:26.569310 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d258fcbb-49bb-4833-968f-238ee75f7283 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:26.593393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d258fcbb-49bb-4833-968f-238ee75f7283 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:26.594636 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d258fcbb-49bb-4833-968f-238ee75f7283 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:26.595725 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d258fcbb-49bb-4833-968f-238ee75f7283 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:26.596458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d258fcbb-49bb-4833-968f-238ee75f7283 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:26.673254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-d258fcbb-49bb-4833-968f-238ee75f7283 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] HTTP exception thrown: Instance 22e97f89-9724-46b1-8d71-56732a4b3c27 could not be found. Apr 16 16:55:26.674163 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d258fcbb-49bb-4833-968f-238ee75f7283 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Returning 404 to user: Instance 22e97f89-9724-46b1-8d71-56732a4b3c27 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:55:26.675284 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d258fcbb-49bb-4833-968f-238ee75f7283 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 404 len: 111 microversion: 2.1 time: 0.113540 Apr 16 16:55:26.676109 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 361/750] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:26 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 16:55:26.685339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8127099e-99fc-4030-86f4-7ee753ecceef tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '.version_select at 0x7f0d4479bc80>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:26.716769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8127099e-99fc-4030-86f4-7ee753ecceef tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322091839" status: 202 len: 0 microversion: 2.1 time: 0.035860 Apr 16 16:55:26.717399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 362/751] 10.222.0.103 () {58 vars in 1216 bytes} [Fri Apr 16 16:55:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322091839 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:26.982365 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0cde7782-2d7a-4691-83c4-3cdccdedbfa4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:26.984149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0cde7782-2d7a-4691-83c4-3cdccdedbfa4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:26.991629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c6463bf6-75d8-4531-af11-71270ed8981b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:26.997794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0cde7782-2d7a-4691-83c4-3cdccdedbfa4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:26.999004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0cde7782-2d7a-4691-83c4-3cdccdedbfa4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:27.002045 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0cde7782-2d7a-4691-83c4-3cdccdedbfa4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:27.003298 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0cde7782-2d7a-4691-83c4-3cdccdedbfa4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:27.004940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c6463bf6-75d8-4531-af11-71270ed8981b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.497308 Apr 16 16:55:27.006428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 390/752] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:26 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:27.152849 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0cde7782-2d7a-4691-83c4-3cdccdedbfa4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 14 microversion: 2.20 time: 0.175649 Apr 16 16:55:27.153833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 363/753] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:26 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:27.237846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-37532d5c-7d4a-4a3a-8c7e-a6c74ea1b7ea tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:27.239354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-37532d5c-7d4a-4a3a-8c7e-a6c74ea1b7ea tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:27.248643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-37532d5c-7d4a-4a3a-8c7e-a6c74ea1b7ea tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:27.249072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-37532d5c-7d4a-4a3a-8c7e-a6c74ea1b7ea tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:27.249929 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-37532d5c-7d4a-4a3a-8c7e-a6c74ea1b7ea tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:27.250992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-37532d5c-7d4a-4a3a-8c7e-a6c74ea1b7ea tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:27.443925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-37532d5c-7d4a-4a3a-8c7e-a6c74ea1b7ea tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "POST /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/action" status: 202 len: 0 microversion: 2.1 time: 0.212937 Apr 16 16:55:27.444779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 391/754] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:55:27 2021] POST /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:55:27.465362 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b3532161-2ffe-45ce-929f-bb8e6b47e6d2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:27.466157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b3532161-2ffe-45ce-929f-bb8e6b47e6d2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:27.476285 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b3532161-2ffe-45ce-929f-bb8e6b47e6d2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:27.477146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b3532161-2ffe-45ce-929f-bb8e6b47e6d2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:27.478171 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b3532161-2ffe-45ce-929f-bb8e6b47e6d2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:27.478771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b3532161-2ffe-45ce-929f-bb8e6b47e6d2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:28.038790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-87e94f5c-be0c-455d-943d-4d24a110aae7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:28.040489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-87e94f5c-be0c-455d-943d-4d24a110aae7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:28.064648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-87e94f5c-be0c-455d-943d-4d24a110aae7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:28.066492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-87e94f5c-be0c-455d-943d-4d24a110aae7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:28.068334 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-87e94f5c-be0c-455d-943d-4d24a110aae7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:28.070208 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-87e94f5c-be0c-455d-943d-4d24a110aae7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:28.302506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b3532161-2ffe-45ce-929f-bb8e6b47e6d2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:28.317314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b3532161-2ffe-45ce-929f-bb8e6b47e6d2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1753 microversion: 2.1 time: 0.867791 Apr 16 16:55:28.318193 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 364/755] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:27 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1753 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:28.324027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cb2ab800-6773-4791-b824-f7c56e7531dc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:28.325502 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cb2ab800-6773-4791-b824-f7c56e7531dc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:28.336087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cb2ab800-6773-4791-b824-f7c56e7531dc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:28.336850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cb2ab800-6773-4791-b824-f7c56e7531dc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:28.337922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cb2ab800-6773-4791-b824-f7c56e7531dc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:28.339013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cb2ab800-6773-4791-b824-f7c56e7531dc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:28.500296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cb2ab800-6773-4791-b824-f7c56e7531dc tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 11133 microversion: 2.20 time: 0.179571 Apr 16 16:55:28.507669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 365/756] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:28 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 11133 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:28.927422 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-87e94f5c-be0c-455d-943d-4d24a110aae7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:28.939475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-87e94f5c-be0c-455d-943d-4d24a110aae7 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.910457 Apr 16 16:55:28.940369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 392/757] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:28 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:29.210111 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2a5bf86a-2e29-41f7-9a27-c9017db92299 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'create', calling method: .version_select at 0x7f0d450eeea0>, body: {"keypair": {"name": "tempest-keypair-1237762689"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:29.241736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-2a5bf86a-2e29-41f7-9a27-c9017db92299 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for project 26fb0e15979d43999b94901003579a6a. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:55:29.247093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-2a5bf86a-2e29-41f7-9a27-c9017db92299 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for user c2e7f3d7b43748658c69c338db617181 and project 26fb0e15979d43999b94901003579a6a. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:55:29.348439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7fbefec3-8887-477f-9cdb-76850b67f7fa tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:29.349825 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7fbefec3-8887-477f-9cdb-76850b67f7fa tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:29.362563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7fbefec3-8887-477f-9cdb-76850b67f7fa tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:29.363562 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7fbefec3-8887-477f-9cdb-76850b67f7fa tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:29.365232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7fbefec3-8887-477f-9cdb-76850b67f7fa tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:29.365429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7fbefec3-8887-477f-9cdb-76850b67f7fa tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:29.569717 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-2a5bf86a-2e29-41f7-9a27-c9017db92299 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for project 26fb0e15979d43999b94901003579a6a. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:55:29.578744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-2a5bf86a-2e29-41f7-9a27-c9017db92299 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for user c2e7f3d7b43748658c69c338db617181 and project 26fb0e15979d43999b94901003579a6a. Resources: {'key_pairs'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:55:29.604233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2a5bf86a-2e29-41f7-9a27-c9017db92299 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.398492 Apr 16 16:55:29.610584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 366/758] 10.222.0.103 () {60 vars in 1153 bytes} [Fri Apr 16 16:55:29 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:29.624706 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8b2b1611-ca8c-49c0-b9b9-9acb451369ea tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:29.627101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8b2b1611-ca8c-49c0-b9b9-9acb451369ea tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:29.650899 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b2b1611-ca8c-49c0-b9b9-9acb451369ea tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:29.651334 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b2b1611-ca8c-49c0-b9b9-9acb451369ea tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:29.652407 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b2b1611-ca8c-49c0-b9b9-9acb451369ea tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:29.662710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b2b1611-ca8c-49c0-b9b9-9acb451369ea tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:29.878327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7fbefec3-8887-477f-9cdb-76850b67f7fa tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:29.889359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7fbefec3-8887-477f-9cdb-76850b67f7fa tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1753 microversion: 2.1 time: 0.545964 Apr 16 16:55:29.890026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 393/759] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:29 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1753 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:29.915238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8b2b1611-ca8c-49c0-b9b9-9acb451369ea tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 18155 microversion: 2.20 time: 0.301562 Apr 16 16:55:29.917105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 367/760] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:29 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 18155 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:29.962818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-cc7204ae-4dc3-4b3e-b643-78c1931fdfbd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:29.963689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-cc7204ae-4dc3-4b3e-b643-78c1931fdfbd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:29.976507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc7204ae-4dc3-4b3e-b643-78c1931fdfbd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:29.977141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc7204ae-4dc3-4b3e-b643-78c1931fdfbd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:29.978129 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc7204ae-4dc3-4b3e-b643-78c1931fdfbd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:29.978750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-cc7204ae-4dc3-4b3e-b643-78c1931fdfbd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:30.699564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-cc7204ae-4dc3-4b3e-b643-78c1931fdfbd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:30.710499 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-cc7204ae-4dc3-4b3e-b643-78c1931fdfbd tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.754455 Apr 16 16:55:30.711252 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 394/761] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:29 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:30.918554 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8421e7bf-1893-423d-a39c-6c964b28e4ad tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:30.919397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8421e7bf-1893-423d-a39c-6c964b28e4ad tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:30.931191 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8421e7bf-1893-423d-a39c-6c964b28e4ad tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:30.931701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8421e7bf-1893-423d-a39c-6c964b28e4ad tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:30.932651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8421e7bf-1893-423d-a39c-6c964b28e4ad tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:30.935653 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6e36c941-aa19-4747-8d04-9851c64f17a7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:30.937079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6e36c941-aa19-4747-8d04-9851c64f17a7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:30.946320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e36c941-aa19-4747-8d04-9851c64f17a7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:30.946894 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e36c941-aa19-4747-8d04-9851c64f17a7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:30.947935 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e36c941-aa19-4747-8d04-9851c64f17a7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:30.948424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e36c941-aa19-4747-8d04-9851c64f17a7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:30.951137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8421e7bf-1893-423d-a39c-6c964b28e4ad tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:31.146690 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6e36c941-aa19-4747-8d04-9851c64f17a7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 18827 microversion: 2.20 time: 0.219630 Apr 16 16:55:31.151072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 395/762] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:30 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 18827 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:31.555984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8421e7bf-1893-423d-a39c-6c964b28e4ad tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:31.567175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8421e7bf-1893-423d-a39c-6c964b28e4ad tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.652914 Apr 16 16:55:31.567356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 368/763] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:30 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:31.729239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d763baab-5fac-43b0-9864-fde31960a1d3 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:31.730011 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d763baab-5fac-43b0-9864-fde31960a1d3 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:31.739350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d763baab-5fac-43b0-9864-fde31960a1d3 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:31.739842 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d763baab-5fac-43b0-9864-fde31960a1d3 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:31.740898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d763baab-5fac-43b0-9864-fde31960a1d3 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:31.741370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d763baab-5fac-43b0-9864-fde31960a1d3 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:32.004107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d763baab-5fac-43b0-9864-fde31960a1d3 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:32.015734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d763baab-5fac-43b0-9864-fde31960a1d3 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.290975 Apr 16 16:55:32.028952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 396/764] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:31 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:32.163864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f7818c76-c0a7-41b6-87bf-b62e3cda3ff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:32.166595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f7818c76-c0a7-41b6-87bf-b62e3cda3ff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:32.185378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f7818c76-c0a7-41b6-87bf-b62e3cda3ff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:32.186822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f7818c76-c0a7-41b6-87bf-b62e3cda3ff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:32.189193 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f7818c76-c0a7-41b6-87bf-b62e3cda3ff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:32.190428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f7818c76-c0a7-41b6-87bf-b62e3cda3ff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:32.365569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f7818c76-c0a7-41b6-87bf-b62e3cda3ff2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 20997 microversion: 2.20 time: 0.208721 Apr 16 16:55:32.366599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 369/765] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:32 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 20997 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:32.483435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1783899341", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5482311a-e6d4-4b31-99e9-5c3f3d5468e8"}], "security_groups": [{"name": "tempest-securitygroup--1214646815"}], "key_name": "tempest-keypair-1237762689", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:32.587132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-afafd232-5faf-40cd-9907-45f3938d2519 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:32.587911 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-afafd232-5faf-40cd-9907-45f3938d2519 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:32.607623 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-afafd232-5faf-40cd-9907-45f3938d2519 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:32.608129 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-afafd232-5faf-40cd-9907-45f3938d2519 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:32.608993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-afafd232-5faf-40cd-9907-45f3938d2519 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:32.609489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-afafd232-5faf-40cd-9907-45f3938d2519 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:32.795157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] validate_networks() for [('5482311a-e6d4-4b31-99e9-5c3f3d5468e8', None, None, None)] {{(pid=99398) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:55:33.084107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-afafd232-5faf-40cd-9907-45f3938d2519 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:33.099714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-afafd232-5faf-40cd-9907-45f3938d2519 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.516728 Apr 16 16:55:33.100733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 370/766] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:32 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:33.106264 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0f795e48-063d-4f85-8b92-596513f89304 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:33.106951 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0f795e48-063d-4f85-8b92-596513f89304 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:33.116144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f795e48-063d-4f85-8b92-596513f89304 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:33.117026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f795e48-063d-4f85-8b92-596513f89304 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:33.118388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f795e48-063d-4f85-8b92-596513f89304 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:33.118880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f795e48-063d-4f85-8b92-596513f89304 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:33.538954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0f795e48-063d-4f85-8b92-596513f89304 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:33.568230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0f795e48-063d-4f85-8b92-596513f89304 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.455555 Apr 16 16:55:33.568230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 371/767] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:33 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:33.583926 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dc4dbc9a-5d19-4ad2-8611-93a6e507eb60 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:33.584974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dc4dbc9a-5d19-4ad2-8611-93a6e507eb60 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:33.604100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc4dbc9a-5d19-4ad2-8611-93a6e507eb60 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:33.604606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc4dbc9a-5d19-4ad2-8611-93a6e507eb60 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:33.605468 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc4dbc9a-5d19-4ad2-8611-93a6e507eb60 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:33.612170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc4dbc9a-5d19-4ad2-8611-93a6e507eb60 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:33.796296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dc4dbc9a-5d19-4ad2-8611-93a6e507eb60 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 22987 microversion: 2.20 time: 0.230925 Apr 16 16:55:33.798112 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 372/768] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:33 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 22987 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:33.928069 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Flavor limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:55:33.928554 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Image limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:55:33.929104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Flavor pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:55:33.929565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Image pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:55:33.930028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:55:33.941062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:33.941634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:33.942557 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:33.943122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:33.963259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for project 26fb0e15979d43999b94901003579a6a. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:55:33.968060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Getting quotas for user c2e7f3d7b43748658c69c338db617181 and project 26fb0e15979d43999b94901003579a6a. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:55:33.980692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Going to run 1 instances... {{(pid=99398) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:55:33.983358 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:55:34.041091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7d928fc7-bc98-4e9b-8701-c08870c2ca0d tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.562292 Apr 16 16:55:34.041791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 397/769] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:55:32 2021] POST /compute/v2.1/servers => generated 404 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:55:34.054801 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2be28b9d-edc3-44a5-a5f7-69b43f507828 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:34.055566 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2be28b9d-edc3-44a5-a5f7-69b43f507828 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:34.133491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d4d8c623-f99d-416d-b7a8-255146d15cf3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:34.134245 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d4d8c623-f99d-416d-b7a8-255146d15cf3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:34.143663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4d8c623-f99d-416d-b7a8-255146d15cf3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:34.144179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4d8c623-f99d-416d-b7a8-255146d15cf3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:34.145113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4d8c623-f99d-416d-b7a8-255146d15cf3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:34.145512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4d8c623-f99d-416d-b7a8-255146d15cf3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:34.152464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2be28b9d-edc3-44a5-a5f7-69b43f507828 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:34.162320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2be28b9d-edc3-44a5-a5f7-69b43f507828 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1242 microversion: 2.1 time: 0.112114 Apr 16 16:55:34.163187 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 373/770] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:34 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:34.415609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d4d8c623-f99d-416d-b7a8-255146d15cf3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:34.427350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d4d8c623-f99d-416d-b7a8-255146d15cf3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.297802 Apr 16 16:55:34.435457 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 398/771] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:34 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:34.582977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0592a037-56d2-435d-afa5-400188a31e0d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:34.583690 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0592a037-56d2-435d-afa5-400188a31e0d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:34.596729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0592a037-56d2-435d-afa5-400188a31e0d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:34.597233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0592a037-56d2-435d-afa5-400188a31e0d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:34.598157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0592a037-56d2-435d-afa5-400188a31e0d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:34.598682 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0592a037-56d2-435d-afa5-400188a31e0d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:34.812427 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5dbe8118-a673-4439-b1cc-c8322dc5acb8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:34.814144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5dbe8118-a673-4439-b1cc-c8322dc5acb8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:34.827713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5dbe8118-a673-4439-b1cc-c8322dc5acb8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:34.829164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5dbe8118-a673-4439-b1cc-c8322dc5acb8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:34.831097 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5dbe8118-a673-4439-b1cc-c8322dc5acb8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:34.832023 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5dbe8118-a673-4439-b1cc-c8322dc5acb8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:34.879216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0592a037-56d2-435d-afa5-400188a31e0d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:34.900940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0592a037-56d2-435d-afa5-400188a31e0d tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1571 microversion: 2.1 time: 0.322900 Apr 16 16:55:34.903765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 374/772] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:34 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1571 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:34.925743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a45fd495-09be-4c3d-8175-fdbc3d278169 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:34.926622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a45fd495-09be-4c3d-8175-fdbc3d278169 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:34.939657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a45fd495-09be-4c3d-8175-fdbc3d278169 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:34.941392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a45fd495-09be-4c3d-8175-fdbc3d278169 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:34.943503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a45fd495-09be-4c3d-8175-fdbc3d278169 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:34.944576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a45fd495-09be-4c3d-8175-fdbc3d278169 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:35.001057 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5dbe8118-a673-4439-b1cc-c8322dc5acb8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 24074 microversion: 2.20 time: 0.194403 Apr 16 16:55:35.002096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 399/773] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:34 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 24074 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:35.158840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a45fd495-09be-4c3d-8175-fdbc3d278169 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "POST /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5/action" status: 202 len: 0 microversion: 2.1 time: 0.239810 Apr 16 16:55:35.159656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 375/774] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:55:34 2021] POST /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:35.174212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-17cf3130-a34f-4627-87d9-619f6691967a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:35.175839 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-17cf3130-a34f-4627-87d9-619f6691967a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:35.183117 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0c6d7e98-c27d-4316-bfa1-bca11e5fb103 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:35.183802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0c6d7e98-c27d-4316-bfa1-bca11e5fb103 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:35.194352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17cf3130-a34f-4627-87d9-619f6691967a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:35.195393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c6d7e98-c27d-4316-bfa1-bca11e5fb103 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:35.195592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17cf3130-a34f-4627-87d9-619f6691967a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:35.195913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c6d7e98-c27d-4316-bfa1-bca11e5fb103 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:35.196775 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c6d7e98-c27d-4316-bfa1-bca11e5fb103 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:35.197265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c6d7e98-c27d-4316-bfa1-bca11e5fb103 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:35.197644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17cf3130-a34f-4627-87d9-619f6691967a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:35.198729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17cf3130-a34f-4627-87d9-619f6691967a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:35.485744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0c6d7e98-c27d-4316-bfa1-bca11e5fb103 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:35.499740 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0c6d7e98-c27d-4316-bfa1-bca11e5fb103 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1294 microversion: 2.1 time: 0.321491 Apr 16 16:55:35.500436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 376/775] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:35 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1294 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:35.510631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-60e74df9-536c-47b7-9a3c-cbe15278ae49 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:35.510631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-60e74df9-536c-47b7-9a3c-cbe15278ae49 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:35.515709 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60e74df9-536c-47b7-9a3c-cbe15278ae49 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:35.516538 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60e74df9-536c-47b7-9a3c-cbe15278ae49 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:35.517518 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60e74df9-536c-47b7-9a3c-cbe15278ae49 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:35.518048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60e74df9-536c-47b7-9a3c-cbe15278ae49 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:35.919626 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-17cf3130-a34f-4627-87d9-619f6691967a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:35.934605 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-17cf3130-a34f-4627-87d9-619f6691967a tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1519 microversion: 2.1 time: 0.769049 Apr 16 16:55:35.936119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 400/776] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:35 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1519 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:36.016688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f9005c41-cf24-4cce-b8ac-4ab3a87db88c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:36.017929 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f9005c41-cf24-4cce-b8ac-4ab3a87db88c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:36.030314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-60e74df9-536c-47b7-9a3c-cbe15278ae49 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:36.036624 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f9005c41-cf24-4cce-b8ac-4ab3a87db88c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:36.038936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f9005c41-cf24-4cce-b8ac-4ab3a87db88c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:36.040095 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f9005c41-cf24-4cce-b8ac-4ab3a87db88c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:36.044029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f9005c41-cf24-4cce-b8ac-4ab3a87db88c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:36.048340 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-60e74df9-536c-47b7-9a3c-cbe15278ae49 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.546614 Apr 16 16:55:36.051049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 377/777] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:35 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:36.518937 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-862175cf-0ec3-4fe8-aedc-691f7ebb494c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:36.519703 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-862175cf-0ec3-4fe8-aedc-691f7ebb494c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:36.528057 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-862175cf-0ec3-4fe8-aedc-691f7ebb494c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:36.528561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-862175cf-0ec3-4fe8-aedc-691f7ebb494c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:36.529424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-862175cf-0ec3-4fe8-aedc-691f7ebb494c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:36.529921 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-862175cf-0ec3-4fe8-aedc-691f7ebb494c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:36.689983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-862175cf-0ec3-4fe8-aedc-691f7ebb494c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:36.698994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-862175cf-0ec3-4fe8-aedc-691f7ebb494c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1300 microversion: 2.1 time: 0.184350 Apr 16 16:55:36.699611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 378/778] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:36 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1300 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:36.955536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d2e6fbe6-832e-41a7-874c-6f93a3b1faed tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:36.956252 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d2e6fbe6-832e-41a7-874c-6f93a3b1faed tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:36.964497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d2e6fbe6-832e-41a7-874c-6f93a3b1faed tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:36.965019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d2e6fbe6-832e-41a7-874c-6f93a3b1faed tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:36.965926 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d2e6fbe6-832e-41a7-874c-6f93a3b1faed tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:36.966482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d2e6fbe6-832e-41a7-874c-6f93a3b1faed tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:37.211908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d2e6fbe6-832e-41a7-874c-6f93a3b1faed tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:37.222060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d2e6fbe6-832e-41a7-874c-6f93a3b1faed tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1519 microversion: 2.1 time: 0.271286 Apr 16 16:55:37.222722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 379/779] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:36 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1519 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:37.227545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8bfe765a-2fd8-48b1-8e09-481653219e28 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:37.228197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8bfe765a-2fd8-48b1-8e09-481653219e28 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:37.237892 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bfe765a-2fd8-48b1-8e09-481653219e28 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:37.238742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bfe765a-2fd8-48b1-8e09-481653219e28 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:37.240124 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bfe765a-2fd8-48b1-8e09-481653219e28 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:37.240925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bfe765a-2fd8-48b1-8e09-481653219e28 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:37.499228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8bfe765a-2fd8-48b1-8e09-481653219e28 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:37.512219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8bfe765a-2fd8-48b1-8e09-481653219e28 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.287888 Apr 16 16:55:37.513246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 380/780] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:37 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:37.865326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-50b46aba-1006-4a58-ae04-4710ce0bff6c req-3d43b6a0-4357-486b-90be-4bd8721f5bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5", "name": "network-vif-unplugged", "status": "completed", "tag": "ee6c6c28-4fef-436e-a001-4f66a8ffef9d"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:37.867198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:55:37.867198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:55:37.877096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-50b46aba-1006-4a58-ae04-4710ce0bff6c req-3d43b6a0-4357-486b-90be-4bd8721f5bf3 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:37.877604 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-50b46aba-1006-4a58-ae04-4710ce0bff6c req-3d43b6a0-4357-486b-90be-4bd8721f5bf3 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:37.898225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.compute.server_external_events [req-50b46aba-1006-4a58-ae04-4710ce0bff6c req-3d43b6a0-4357-486b-90be-4bd8721f5bf3 service nova] Unable to find a host for instance e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5. Dropping event network-vif-unplugged {{(pid=99399) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 16 16:55:37.899265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-50b46aba-1006-4a58-ae04-4710ce0bff6c req-3d43b6a0-4357-486b-90be-4bd8721f5bf3 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.209422 Apr 16 16:55:37.899938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 381/781] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:55:37 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 211 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 16 16:55:37.905195 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bf54cd11-7db8-49ef-a017-174af2309b85 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:37.905857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bf54cd11-7db8-49ef-a017-174af2309b85 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:37.914482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf54cd11-7db8-49ef-a017-174af2309b85 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:37.914984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf54cd11-7db8-49ef-a017-174af2309b85 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:37.915827 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf54cd11-7db8-49ef-a017-174af2309b85 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:37.916309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bf54cd11-7db8-49ef-a017-174af2309b85 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:38.080558 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bf54cd11-7db8-49ef-a017-174af2309b85 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:38.090968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bf54cd11-7db8-49ef-a017-174af2309b85 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1300 microversion: 2.1 time: 0.189608 Apr 16 16:55:38.091663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 382/782] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:37 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:38.243056 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ccc9b4f0-7071-4720-ba68-79679b0935c9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:38.243821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ccc9b4f0-7071-4720-ba68-79679b0935c9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:38.253924 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ccc9b4f0-7071-4720-ba68-79679b0935c9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:38.254507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ccc9b4f0-7071-4720-ba68-79679b0935c9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:38.255492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ccc9b4f0-7071-4720-ba68-79679b0935c9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:38.256032 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ccc9b4f0-7071-4720-ba68-79679b0935c9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:38.516296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ccc9b4f0-7071-4720-ba68-79679b0935c9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:38.526228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ccc9b4f0-7071-4720-ba68-79679b0935c9 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1519 microversion: 2.1 time: 0.287691 Apr 16 16:55:38.526944 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 383/783] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:38 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:38.542446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f9dc9ac5-7c9c-4d28-ab91-3a1fef41695f tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:38.543595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f9dc9ac5-7c9c-4d28-ab91-3a1fef41695f tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:38.561473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f9dc9ac5-7c9c-4d28-ab91-3a1fef41695f tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:38.563543 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f9dc9ac5-7c9c-4d28-ab91-3a1fef41695f tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:38.565464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f9dc9ac5-7c9c-4d28-ab91-3a1fef41695f tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:38.566265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f9dc9ac5-7c9c-4d28-ab91-3a1fef41695f tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:38.597042 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f9005c41-cf24-4cce-b8ac-4ab3a87db88c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 27595 microversion: 2.20 time: 2.584865 Apr 16 16:55:38.598363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 401/784] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:36 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 27595 bytes in 2587 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:55:39.027699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f9dc9ac5-7c9c-4d28-ab91-3a1fef41695f tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:39.063809 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f9dc9ac5-7c9c-4d28-ab91-3a1fef41695f tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.528321 Apr 16 16:55:39.066320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 384/785] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:38 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:39.114755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6dea8b93-9a06-4bb5-b95b-660278c8a634 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:39.116511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6dea8b93-9a06-4bb5-b95b-660278c8a634 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:39.127816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6dea8b93-9a06-4bb5-b95b-660278c8a634 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:39.128759 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6dea8b93-9a06-4bb5-b95b-660278c8a634 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:39.130452 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6dea8b93-9a06-4bb5-b95b-660278c8a634 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:39.131402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6dea8b93-9a06-4bb5-b95b-660278c8a634 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:39.374645 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6dea8b93-9a06-4bb5-b95b-660278c8a634 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:39.384647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6dea8b93-9a06-4bb5-b95b-660278c8a634 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1300 microversion: 2.1 time: 0.276407 Apr 16 16:55:39.385381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 402/786] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:39 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1300 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:39.546421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ae920ae2-fa20-4f08-aa91-0b58a32f47de tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:39.547386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ae920ae2-fa20-4f08-aa91-0b58a32f47de tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:39.565601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae920ae2-fa20-4f08-aa91-0b58a32f47de tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:39.566255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae920ae2-fa20-4f08-aa91-0b58a32f47de tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:39.567625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae920ae2-fa20-4f08-aa91-0b58a32f47de tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:39.568125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ae920ae2-fa20-4f08-aa91-0b58a32f47de tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:39.620320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-629aa711-700d-495c-8c38-ad9ccfb1bb3a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:39.623077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-629aa711-700d-495c-8c38-ad9ccfb1bb3a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:39.645906 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-629aa711-700d-495c-8c38-ad9ccfb1bb3a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:39.646622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-629aa711-700d-495c-8c38-ad9ccfb1bb3a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:39.647602 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-629aa711-700d-495c-8c38-ad9ccfb1bb3a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:39.648580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-629aa711-700d-495c-8c38-ad9ccfb1bb3a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:39.790946 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-629aa711-700d-495c-8c38-ad9ccfb1bb3a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 28008 microversion: 2.20 time: 0.182008 Apr 16 16:55:39.791817 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 403/787] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:39 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 28008 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:40.096713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7b8f44b4-7508-417b-8759-332c574b8724 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:40.098170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7b8f44b4-7508-417b-8759-332c574b8724 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:40.108794 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b8f44b4-7508-417b-8759-332c574b8724 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:40.109980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b8f44b4-7508-417b-8759-332c574b8724 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:40.111515 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b8f44b4-7508-417b-8759-332c574b8724 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:40.112050 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b8f44b4-7508-417b-8759-332c574b8724 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:40.525730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ae920ae2-fa20-4f08-aa91-0b58a32f47de tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:40.536225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ae920ae2-fa20-4f08-aa91-0b58a32f47de tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1521 microversion: 2.1 time: 0.994604 Apr 16 16:55:40.542580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 385/788] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:39 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1521 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:40.543127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6e403245-72a5-4390-a09a-3fb1dd68a468 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:40.544062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6e403245-72a5-4390-a09a-3fb1dd68a468 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:40.553745 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e403245-72a5-4390-a09a-3fb1dd68a468 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:40.554382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e403245-72a5-4390-a09a-3fb1dd68a468 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:40.555293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e403245-72a5-4390-a09a-3fb1dd68a468 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:40.555952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e403245-72a5-4390-a09a-3fb1dd68a468 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:40.716310 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7b8f44b4-7508-417b-8759-332c574b8724 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:40.727075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7b8f44b4-7508-417b-8759-332c574b8724 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.635320 Apr 16 16:55:40.727945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 404/789] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:40 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:40.806596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d598471c-97a4-4fc6-866e-669258978ec5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:40.808164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d598471c-97a4-4fc6-866e-669258978ec5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:40.822633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d598471c-97a4-4fc6-866e-669258978ec5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:40.823397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d598471c-97a4-4fc6-866e-669258978ec5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:40.824818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d598471c-97a4-4fc6-866e-669258978ec5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:40.825640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d598471c-97a4-4fc6-866e-669258978ec5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:40.889076 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6e403245-72a5-4390-a09a-3fb1dd68a468 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:40.900379 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6e403245-72a5-4390-a09a-3fb1dd68a468 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.361495 Apr 16 16:55:40.900944 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 386/790] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:40 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:41.557376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6e3bda2d-f935-484a-977e-8e9db42b4c2e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:41.558429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6e3bda2d-f935-484a-977e-8e9db42b4c2e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:41.568738 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e3bda2d-f935-484a-977e-8e9db42b4c2e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:41.569246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e3bda2d-f935-484a-977e-8e9db42b4c2e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:41.570092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e3bda2d-f935-484a-977e-8e9db42b4c2e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:41.570602 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6e3bda2d-f935-484a-977e-8e9db42b4c2e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:41.817130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6e3bda2d-f935-484a-977e-8e9db42b4c2e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:41.826444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6e3bda2d-f935-484a-977e-8e9db42b4c2e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1521 microversion: 2.1 time: 0.274687 Apr 16 16:55:41.827090 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 387/791] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:41 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:41.832480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dc346bc3-4455-4c00-b06a-672a8b35c911 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:41.833148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dc346bc3-4455-4c00-b06a-672a8b35c911 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:41.840961 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc346bc3-4455-4c00-b06a-672a8b35c911 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:41.841548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc346bc3-4455-4c00-b06a-672a8b35c911 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:41.842370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc346bc3-4455-4c00-b06a-672a8b35c911 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:41.842866 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc346bc3-4455-4c00-b06a-672a8b35c911 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:42.077808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dc346bc3-4455-4c00-b06a-672a8b35c911 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:42.088763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dc346bc3-4455-4c00-b06a-672a8b35c911 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.260613 Apr 16 16:55:42.089390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 388/792] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:41 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:42.094380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b0424d26-ba66-4ddf-92f0-5317a6951848 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:42.095214 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b0424d26-ba66-4ddf-92f0-5317a6951848 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:42.103743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b0424d26-ba66-4ddf-92f0-5317a6951848 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:42.104107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b0424d26-ba66-4ddf-92f0-5317a6951848 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:42.104960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b0424d26-ba66-4ddf-92f0-5317a6951848 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:42.105450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b0424d26-ba66-4ddf-92f0-5317a6951848 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:42.481526 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b0424d26-ba66-4ddf-92f0-5317a6951848 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:42.491349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b0424d26-ba66-4ddf-92f0-5317a6951848 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.400882 Apr 16 16:55:42.491973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 389/793] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:42 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:42.847933 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1e4845b4-c4fa-4a35-b40d-ea219f61e4a4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:42.848637 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1e4845b4-c4fa-4a35-b40d-ea219f61e4a4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:42.856723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e4845b4-c4fa-4a35-b40d-ea219f61e4a4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:42.857232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e4845b4-c4fa-4a35-b40d-ea219f61e4a4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:42.858073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e4845b4-c4fa-4a35-b40d-ea219f61e4a4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:42.858710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e4845b4-c4fa-4a35-b40d-ea219f61e4a4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:43.080724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1e4845b4-c4fa-4a35-b40d-ea219f61e4a4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:43.089917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1e4845b4-c4fa-4a35-b40d-ea219f61e4a4 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1521 microversion: 2.1 time: 0.246645 Apr 16 16:55:43.090843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 390/794] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:42 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:43.108301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bacac603-3ec0-45ec-bc2b-fc30c24d3639 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:43.108886 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bacac603-3ec0-45ec-bc2b-fc30c24d3639 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:43.117089 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bacac603-3ec0-45ec-bc2b-fc30c24d3639 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:43.117593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bacac603-3ec0-45ec-bc2b-fc30c24d3639 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:43.118456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bacac603-3ec0-45ec-bc2b-fc30c24d3639 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:43.118938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bacac603-3ec0-45ec-bc2b-fc30c24d3639 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:43.345487 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d598471c-97a4-4fc6-866e-669258978ec5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 28255 microversion: 2.20 time: 2.543601 Apr 16 16:55:43.347772 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 405/795] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:40 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 28255 bytes in 2547 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:55:43.410071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bacac603-3ec0-45ec-bc2b-fc30c24d3639 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:43.430101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bacac603-3ec0-45ec-bc2b-fc30c24d3639 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.326096 Apr 16 16:55:43.431751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 391/796] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:43 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:43.510744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-eae02aa0-f333-4686-8a6d-92d884ceca82 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:43.511857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-eae02aa0-f333-4686-8a6d-92d884ceca82 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:43.522613 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eae02aa0-f333-4686-8a6d-92d884ceca82 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:43.523590 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eae02aa0-f333-4686-8a6d-92d884ceca82 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:43.524592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eae02aa0-f333-4686-8a6d-92d884ceca82 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:43.525199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eae02aa0-f333-4686-8a6d-92d884ceca82 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:43.920127 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-eae02aa0-f333-4686-8a6d-92d884ceca82 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:43.936645 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-eae02aa0-f333-4686-8a6d-92d884ceca82 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.430758 Apr 16 16:55:43.937665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 406/797] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:43 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:44.109606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-97c9814d-9ff5-49f5-8a24-9871e0079bbc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:44.110550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-97c9814d-9ff5-49f5-8a24-9871e0079bbc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:44.118849 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-97c9814d-9ff5-49f5-8a24-9871e0079bbc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:44.119462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-97c9814d-9ff5-49f5-8a24-9871e0079bbc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:44.120440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-97c9814d-9ff5-49f5-8a24-9871e0079bbc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:44.121168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-97c9814d-9ff5-49f5-8a24-9871e0079bbc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:44.360274 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4f32fd73-c1d9-439c-967e-76d2a8c14d22 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:44.361823 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4f32fd73-c1d9-439c-967e-76d2a8c14d22 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:44.371018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f32fd73-c1d9-439c-967e-76d2a8c14d22 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:44.372062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f32fd73-c1d9-439c-967e-76d2a8c14d22 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:44.373037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f32fd73-c1d9-439c-967e-76d2a8c14d22 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:44.373748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f32fd73-c1d9-439c-967e-76d2a8c14d22 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:44.539614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4f32fd73-c1d9-439c-967e-76d2a8c14d22 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 28255 microversion: 2.20 time: 0.183888 Apr 16 16:55:44.540382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 407/798] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:44 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 28255 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:55:44.548018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-29c3b04d-a507-4a82-baf5-5987c59c5791 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:44.548969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-29c3b04d-a507-4a82-baf5-5987c59c5791 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:44.558977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29c3b04d-a507-4a82-baf5-5987c59c5791 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:44.561198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29c3b04d-a507-4a82-baf5-5987c59c5791 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:44.561198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29c3b04d-a507-4a82-baf5-5987c59c5791 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:44.561574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29c3b04d-a507-4a82-baf5-5987c59c5791 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:44.581351 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-97c9814d-9ff5-49f5-8a24-9871e0079bbc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:44.600788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-97c9814d-9ff5-49f5-8a24-9871e0079bbc tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1577 microversion: 2.1 time: 0.495206 Apr 16 16:55:44.603781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 392/799] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:44 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1577 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:44.956215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2a7676eb-8222-4513-8c69-b0beae0e6674 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:44.957536 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2a7676eb-8222-4513-8c69-b0beae0e6674 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:44.965686 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a7676eb-8222-4513-8c69-b0beae0e6674 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:44.966190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a7676eb-8222-4513-8c69-b0beae0e6674 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:44.967071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a7676eb-8222-4513-8c69-b0beae0e6674 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:44.967556 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2a7676eb-8222-4513-8c69-b0beae0e6674 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:45.120370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-29c3b04d-a507-4a82-baf5-5987c59c5791 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:45.130906 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-29c3b04d-a507-4a82-baf5-5987c59c5791 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.588822 Apr 16 16:55:45.131553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 408/800] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:44 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:45.191565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-1688081b-4e46-4da2-98bb-d15ff4e7bde4 req-5e3f0d84-528d-4da5-b429-ace98e5ad4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb2a15c6-8601-4a70-9281-a1259a155c9e", "tag": "5b904929-85e9-4626-bc83-c45200f69e9a"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:45.191974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:55:45.191974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:55:45.206551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-1688081b-4e46-4da2-98bb-d15ff4e7bde4 req-5e3f0d84-528d-4da5-b429-ace98e5ad4d9 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:45.207057 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-1688081b-4e46-4da2-98bb-d15ff4e7bde4 req-5e3f0d84-528d-4da5-b429-ace98e5ad4d9 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:45.229355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-1688081b-4e46-4da2-98bb-d15ff4e7bde4 req-5e3f0d84-528d-4da5-b429-ace98e5ad4d9 service nova] Creating event network-changed:5b904929-85e9-4626-bc83-c45200f69e9a for instance eb2a15c6-8601-4a70-9281-a1259a155c9e on hv-cinder-73362 Apr 16 16:55:45.236017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-1688081b-4e46-4da2-98bb-d15ff4e7bde4 req-5e3f0d84-528d-4da5-b429-ace98e5ad4d9 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052037 Apr 16 16:55:45.236959 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 409/801] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:55:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:55:45.349561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2a7676eb-8222-4513-8c69-b0beae0e6674 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:45.359031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2a7676eb-8222-4513-8c69-b0beae0e6674 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.407408 Apr 16 16:55:45.360962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 393/802] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:44 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:45.554837 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1c0ba0c9-7462-4b8e-bef6-559c9e908dd5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:45.556554 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1c0ba0c9-7462-4b8e-bef6-559c9e908dd5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:45.565969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c0ba0c9-7462-4b8e-bef6-559c9e908dd5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:45.566700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c0ba0c9-7462-4b8e-bef6-559c9e908dd5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:45.570003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c0ba0c9-7462-4b8e-bef6-559c9e908dd5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:45.570003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c0ba0c9-7462-4b8e-bef6-559c9e908dd5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:45.622783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-498f9ceb-3fdf-43b6-b6e2-0f8090f03015 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:45.624152 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-498f9ceb-3fdf-43b6-b6e2-0f8090f03015 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:45.637530 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-498f9ceb-3fdf-43b6-b6e2-0f8090f03015 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:45.638727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-498f9ceb-3fdf-43b6-b6e2-0f8090f03015 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:45.640004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-498f9ceb-3fdf-43b6-b6e2-0f8090f03015 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:45.640762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-498f9ceb-3fdf-43b6-b6e2-0f8090f03015 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:45.692117 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1c0ba0c9-7462-4b8e-bef6-559c9e908dd5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 28255 microversion: 2.20 time: 0.141471 Apr 16 16:55:45.697938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 410/803] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:45 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 28255 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:46.161452 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ee99090c-6c3d-45c0-827d-3aad71414f83 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:46.163091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ee99090c-6c3d-45c0-827d-3aad71414f83 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:46.175807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee99090c-6c3d-45c0-827d-3aad71414f83 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:46.176625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee99090c-6c3d-45c0-827d-3aad71414f83 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:46.177658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee99090c-6c3d-45c0-827d-3aad71414f83 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:46.178365 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ee99090c-6c3d-45c0-827d-3aad71414f83 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:46.354398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-498f9ceb-3fdf-43b6-b6e2-0f8090f03015 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:46.366662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-498f9ceb-3fdf-43b6-b6e2-0f8090f03015 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1577 microversion: 2.1 time: 0.748864 Apr 16 16:55:46.371487 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 394/804] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:45 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1577 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:46.379871 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3166868b-33fa-4442-8dc2-3e6db43444a2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:46.380762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3166868b-33fa-4442-8dc2-3e6db43444a2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:46.389785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3166868b-33fa-4442-8dc2-3e6db43444a2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:46.391101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3166868b-33fa-4442-8dc2-3e6db43444a2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:46.392132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3166868b-33fa-4442-8dc2-3e6db43444a2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:46.392819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3166868b-33fa-4442-8dc2-3e6db43444a2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:46.651267 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ee99090c-6c3d-45c0-827d-3aad71414f83 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:46.661984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ee99090c-6c3d-45c0-827d-3aad71414f83 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.515502 Apr 16 16:55:46.662670 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 411/805] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:46 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:46.705913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b8a7f69e-3a3e-4bf8-a2ab-d5cba5c6daef tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:46.707519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b8a7f69e-3a3e-4bf8-a2ab-d5cba5c6daef tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:46.718169 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8a7f69e-3a3e-4bf8-a2ab-d5cba5c6daef tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:46.718786 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8a7f69e-3a3e-4bf8-a2ab-d5cba5c6daef tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:46.720816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8a7f69e-3a3e-4bf8-a2ab-d5cba5c6daef tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:46.721320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b8a7f69e-3a3e-4bf8-a2ab-d5cba5c6daef tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:46.833795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b8a7f69e-3a3e-4bf8-a2ab-d5cba5c6daef tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 28545 microversion: 2.20 time: 0.132111 Apr 16 16:55:46.838073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 412/806] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:46 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 28545 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:46.891218 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3166868b-33fa-4442-8dc2-3e6db43444a2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:46.900622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3166868b-33fa-4442-8dc2-3e6db43444a2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.525773 Apr 16 16:55:46.901200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 395/807] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:46 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:47.396567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a25aea9f-cc6d-4b84-9e85-4d1d3602b162 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:47.397703 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a25aea9f-cc6d-4b84-9e85-4d1d3602b162 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:47.406614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a25aea9f-cc6d-4b84-9e85-4d1d3602b162 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:47.407155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a25aea9f-cc6d-4b84-9e85-4d1d3602b162 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:47.408010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a25aea9f-cc6d-4b84-9e85-4d1d3602b162 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:47.408512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a25aea9f-cc6d-4b84-9e85-4d1d3602b162 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:47.644301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a25aea9f-cc6d-4b84-9e85-4d1d3602b162 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:47.653906 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a25aea9f-cc6d-4b84-9e85-4d1d3602b162 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1577 microversion: 2.1 time: 0.263075 Apr 16 16:55:47.654601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 413/808] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:47 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1577 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:47.681390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-be539e24-0b6c-4f52-beb9-7d52f30643e9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:47.682098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-be539e24-0b6c-4f52-beb9-7d52f30643e9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:47.690462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be539e24-0b6c-4f52-beb9-7d52f30643e9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:47.690974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be539e24-0b6c-4f52-beb9-7d52f30643e9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:47.691829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be539e24-0b6c-4f52-beb9-7d52f30643e9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:47.692325 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be539e24-0b6c-4f52-beb9-7d52f30643e9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:47.846953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1e8a99f9-61e3-4e9d-83dd-00e8300c8b9b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:47.848409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1e8a99f9-61e3-4e9d-83dd-00e8300c8b9b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:47.856608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e8a99f9-61e3-4e9d-83dd-00e8300c8b9b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:47.857120 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e8a99f9-61e3-4e9d-83dd-00e8300c8b9b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:47.858017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e8a99f9-61e3-4e9d-83dd-00e8300c8b9b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:47.858873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e8a99f9-61e3-4e9d-83dd-00e8300c8b9b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:47.933294 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-be539e24-0b6c-4f52-beb9-7d52f30643e9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:47.944061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-be539e24-0b6c-4f52-beb9-7d52f30643e9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.266727 Apr 16 16:55:47.944735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 396/809] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:47 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:47.949540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-16e59b68-ae8f-45fb-8875-92d3f7fc9456 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:47.950184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-16e59b68-ae8f-45fb-8875-92d3f7fc9456 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:47.959207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-16e59b68-ae8f-45fb-8875-92d3f7fc9456 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:47.959707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-16e59b68-ae8f-45fb-8875-92d3f7fc9456 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:47.960545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-16e59b68-ae8f-45fb-8875-92d3f7fc9456 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:47.961029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-16e59b68-ae8f-45fb-8875-92d3f7fc9456 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:47.970755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1e8a99f9-61e3-4e9d-83dd-00e8300c8b9b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 28712 microversion: 2.20 time: 0.128369 Apr 16 16:55:47.971609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 414/810] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:47 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 28712 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:55:48.189853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-16e59b68-ae8f-45fb-8875-92d3f7fc9456 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:48.199816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-16e59b68-ae8f-45fb-8875-92d3f7fc9456 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.253996 Apr 16 16:55:48.200445 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 397/811] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:47 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:48.674264 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-212dd528-bbfb-4fc5-89fc-446e42cfca4e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:48.675094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-212dd528-bbfb-4fc5-89fc-446e42cfca4e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:48.683870 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-212dd528-bbfb-4fc5-89fc-446e42cfca4e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:48.684378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-212dd528-bbfb-4fc5-89fc-446e42cfca4e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:48.685233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-212dd528-bbfb-4fc5-89fc-446e42cfca4e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:48.685732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-212dd528-bbfb-4fc5-89fc-446e42cfca4e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:48.916269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-212dd528-bbfb-4fc5-89fc-446e42cfca4e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:48.925651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-212dd528-bbfb-4fc5-89fc-446e42cfca4e tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1577 microversion: 2.1 time: 0.256968 Apr 16 16:55:48.926212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 415/812] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:48 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1577 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:48.970077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6ac3751d-eda5-4686-9d07-b1ad999c0c6e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:48.971463 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6ac3751d-eda5-4686-9d07-b1ad999c0c6e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:48.981083 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ac3751d-eda5-4686-9d07-b1ad999c0c6e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:48.981800 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ac3751d-eda5-4686-9d07-b1ad999c0c6e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:48.982714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ac3751d-eda5-4686-9d07-b1ad999c0c6e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:48.983199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ac3751d-eda5-4686-9d07-b1ad999c0c6e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:48.985450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-886ed2a1-7563-498c-bf1e-0183c9d72626 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:48.986547 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-886ed2a1-7563-498c-bf1e-0183c9d72626 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:48.994529 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-886ed2a1-7563-498c-bf1e-0183c9d72626 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:48.995791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-886ed2a1-7563-498c-bf1e-0183c9d72626 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:48.996265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-886ed2a1-7563-498c-bf1e-0183c9d72626 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:48.996773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-886ed2a1-7563-498c-bf1e-0183c9d72626 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:49.216559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6ac3751d-eda5-4686-9d07-b1ad999c0c6e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:49.228252 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6ac3751d-eda5-4686-9d07-b1ad999c0c6e tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.263417 Apr 16 16:55:49.229102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 398/813] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:48 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:49.234312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-367c2137-5743-4c30-a7ff-7de230cc3140 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:49.234976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-367c2137-5743-4c30-a7ff-7de230cc3140 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:49.242910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-367c2137-5743-4c30-a7ff-7de230cc3140 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:49.243412 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-367c2137-5743-4c30-a7ff-7de230cc3140 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:49.244264 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-367c2137-5743-4c30-a7ff-7de230cc3140 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:49.244744 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-367c2137-5743-4c30-a7ff-7de230cc3140 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:49.488659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-367c2137-5743-4c30-a7ff-7de230cc3140 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:49.498176 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-367c2137-5743-4c30-a7ff-7de230cc3140 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.267952 Apr 16 16:55:49.499097 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 399/814] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:49 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:49.946018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b5a6fa9c-c20d-41fd-bce2-5d2ebd147cbb tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:49.946736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b5a6fa9c-c20d-41fd-bce2-5d2ebd147cbb tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:49.956209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5a6fa9c-c20d-41fd-bce2-5d2ebd147cbb tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:49.956757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5a6fa9c-c20d-41fd-bce2-5d2ebd147cbb tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:49.957608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5a6fa9c-c20d-41fd-bce2-5d2ebd147cbb tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:49.958095 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5a6fa9c-c20d-41fd-bce2-5d2ebd147cbb tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:50.199691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b5a6fa9c-c20d-41fd-bce2-5d2ebd147cbb tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:50.208933 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b5a6fa9c-c20d-41fd-bce2-5d2ebd147cbb tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1577 microversion: 2.1 time: 0.267620 Apr 16 16:55:50.209558 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 400/815] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:49 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1577 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:50.247983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f8928c27-bafc-4524-9fcb-a5550a42b040 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:50.248645 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f8928c27-bafc-4524-9fcb-a5550a42b040 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:50.257079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f8928c27-bafc-4524-9fcb-a5550a42b040 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:50.257595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f8928c27-bafc-4524-9fcb-a5550a42b040 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:50.258476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f8928c27-bafc-4524-9fcb-a5550a42b040 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:50.258970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f8928c27-bafc-4524-9fcb-a5550a42b040 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:50.487344 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f8928c27-bafc-4524-9fcb-a5550a42b040 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:50.497132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f8928c27-bafc-4524-9fcb-a5550a42b040 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.253402 Apr 16 16:55:50.497753 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 401/816] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:50 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:50.527421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1c008d12-bd85-4c05-a1aa-397cd9ad5824 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:50.528166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1c008d12-bd85-4c05-a1aa-397cd9ad5824 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:50.537559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c008d12-bd85-4c05-a1aa-397cd9ad5824 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:50.538100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c008d12-bd85-4c05-a1aa-397cd9ad5824 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:50.539049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c008d12-bd85-4c05-a1aa-397cd9ad5824 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:50.539591 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c008d12-bd85-4c05-a1aa-397cd9ad5824 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:50.765433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1c008d12-bd85-4c05-a1aa-397cd9ad5824 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:50.775188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1c008d12-bd85-4c05-a1aa-397cd9ad5824 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.252202 Apr 16 16:55:50.775803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 402/817] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:50 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:55:51.071907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-886ed2a1-7563-498c-bf1e-0183c9d72626 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 28712 microversion: 2.20 time: 2.091264 Apr 16 16:55:51.072867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 416/818] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:48 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 28712 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:55:51.228532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b316c805-1fcc-43e7-a157-5c652330a925 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:51.229296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b316c805-1fcc-43e7-a157-5c652330a925 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:51.237725 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b316c805-1fcc-43e7-a157-5c652330a925 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:51.239088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b316c805-1fcc-43e7-a157-5c652330a925 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:51.240061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b316c805-1fcc-43e7-a157-5c652330a925 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:51.240643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b316c805-1fcc-43e7-a157-5c652330a925 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:51.479828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b316c805-1fcc-43e7-a157-5c652330a925 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:51.490622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b316c805-1fcc-43e7-a157-5c652330a925 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1577 microversion: 2.1 time: 0.266083 Apr 16 16:55:51.491336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 403/819] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:51 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1577 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:51.517986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-582f067a-8393-40f6-95b6-92c62071afcc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:51.519010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-582f067a-8393-40f6-95b6-92c62071afcc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:51.528236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-582f067a-8393-40f6-95b6-92c62071afcc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:51.528974 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-582f067a-8393-40f6-95b6-92c62071afcc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:51.529821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-582f067a-8393-40f6-95b6-92c62071afcc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:51.530364 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-582f067a-8393-40f6-95b6-92c62071afcc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:51.762956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-582f067a-8393-40f6-95b6-92c62071afcc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:51.773224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-582f067a-8393-40f6-95b6-92c62071afcc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1758 microversion: 2.1 time: 0.260327 Apr 16 16:55:51.773790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 417/820] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:51 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1758 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:51.793616 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-31c71088-fa4a-4534-81cb-f4ab808f2b77 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:51.794305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-31c71088-fa4a-4534-81cb-f4ab808f2b77 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:51.803482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-31c71088-fa4a-4534-81cb-f4ab808f2b77 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:51.803987 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-31c71088-fa4a-4534-81cb-f4ab808f2b77 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:51.804841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-31c71088-fa4a-4534-81cb-f4ab808f2b77 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:51.805340 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-31c71088-fa4a-4534-81cb-f4ab808f2b77 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:52.038215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-31c71088-fa4a-4534-81cb-f4ab808f2b77 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:52.049889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-31c71088-fa4a-4534-81cb-f4ab808f2b77 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.260567 Apr 16 16:55:52.050931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 404/821] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:51 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:52.085322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e81b1a16-dbe7-4bb1-9832-88f35f81a107 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:52.086409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e81b1a16-dbe7-4bb1-9832-88f35f81a107 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:52.095425 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e81b1a16-dbe7-4bb1-9832-88f35f81a107 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:52.095546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e81b1a16-dbe7-4bb1-9832-88f35f81a107 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:52.096417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e81b1a16-dbe7-4bb1-9832-88f35f81a107 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:52.096959 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e81b1a16-dbe7-4bb1-9832-88f35f81a107 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:52.219083 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e81b1a16-dbe7-4bb1-9832-88f35f81a107 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 28712 microversion: 2.20 time: 0.136800 Apr 16 16:55:52.219934 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 418/822] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:52 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 28712 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:52.511755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-caedcb0e-5e12-40a9-afa6-4d45707e644f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:52.512636 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-caedcb0e-5e12-40a9-afa6-4d45707e644f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:52.522055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caedcb0e-5e12-40a9-afa6-4d45707e644f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:52.522623 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caedcb0e-5e12-40a9-afa6-4d45707e644f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:52.523840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caedcb0e-5e12-40a9-afa6-4d45707e644f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:52.524370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caedcb0e-5e12-40a9-afa6-4d45707e644f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:52.758840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-caedcb0e-5e12-40a9-afa6-4d45707e644f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:52.769107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-caedcb0e-5e12-40a9-afa6-4d45707e644f tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1577 microversion: 2.1 time: 0.262356 Apr 16 16:55:52.769749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 405/823] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:52 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1577 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:52.793300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-522f8751-03e2-4d30-9d01-a768e99bb2ed tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:52.794223 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-522f8751-03e2-4d30-9d01-a768e99bb2ed tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:52.803693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-522f8751-03e2-4d30-9d01-a768e99bb2ed tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:52.806777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-522f8751-03e2-4d30-9d01-a768e99bb2ed tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:52.808073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-522f8751-03e2-4d30-9d01-a768e99bb2ed tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:52.808789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-522f8751-03e2-4d30-9d01-a768e99bb2ed tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:53.069046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-83c378cc-bd30-418b-8529-c0c977799135 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:53.069757 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-83c378cc-bd30-418b-8529-c0c977799135 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:53.079602 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-83c378cc-bd30-418b-8529-c0c977799135 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:53.080116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-83c378cc-bd30-418b-8529-c0c977799135 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:53.080986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-83c378cc-bd30-418b-8529-c0c977799135 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:53.081481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-83c378cc-bd30-418b-8529-c0c977799135 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:53.088733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-522f8751-03e2-4d30-9d01-a768e99bb2ed tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:53.099723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-522f8751-03e2-4d30-9d01-a768e99bb2ed tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1761 microversion: 2.1 time: 0.310730 Apr 16 16:55:53.100588 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 419/824] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:52 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1761 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:53.231962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c82e7927-dfc2-4540-9c1d-28ea9f87777d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:53.233057 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c82e7927-dfc2-4540-9c1d-28ea9f87777d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:53.242822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c82e7927-dfc2-4540-9c1d-28ea9f87777d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:53.243734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c82e7927-dfc2-4540-9c1d-28ea9f87777d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:53.244254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c82e7927-dfc2-4540-9c1d-28ea9f87777d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:53.244834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c82e7927-dfc2-4540-9c1d-28ea9f87777d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:53.321003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-83c378cc-bd30-418b-8529-c0c977799135 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:53.331314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-83c378cc-bd30-418b-8529-c0c977799135 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.266317 Apr 16 16:55:53.331953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 406/825] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:53 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:53.362750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c82e7927-dfc2-4540-9c1d-28ea9f87777d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 28712 microversion: 2.20 time: 0.134616 Apr 16 16:55:53.363838 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 420/826] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:53 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 28712 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:55:53.485933 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-fed81653-254c-4be8-81f5-d70f07f6ce54 req-83e8f841-efbf-47d7-be2a-37cb2a38d8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb2a15c6-8601-4a70-9281-a1259a155c9e", "name": "network-vif-plugged", "status": "completed", "tag": "5b904929-85e9-4626-bc83-c45200f69e9a"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:53.487714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:55:53.487714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:55:53.497004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-fed81653-254c-4be8-81f5-d70f07f6ce54 req-83e8f841-efbf-47d7-be2a-37cb2a38d8ff service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:53.497651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-fed81653-254c-4be8-81f5-d70f07f6ce54 req-83e8f841-efbf-47d7-be2a-37cb2a38d8ff service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:53.516203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-fed81653-254c-4be8-81f5-d70f07f6ce54 req-83e8f841-efbf-47d7-be2a-37cb2a38d8ff service nova] Creating event network-vif-plugged:5b904929-85e9-4626-bc83-c45200f69e9a for instance eb2a15c6-8601-4a70-9281-a1259a155c9e on hv-cinder-73362 Apr 16 16:55:53.521525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-fed81653-254c-4be8-81f5-d70f07f6ce54 req-83e8f841-efbf-47d7-be2a-37cb2a38d8ff service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040410 Apr 16 16:55:53.522194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 407/827] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:55:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:55:53.790209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-26162a8a-3874-4d3a-835b-313b8693cb68 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:53.791359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-26162a8a-3874-4d3a-835b-313b8693cb68 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:53.802318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-26162a8a-3874-4d3a-835b-313b8693cb68 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:53.802884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-26162a8a-3874-4d3a-835b-313b8693cb68 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:53.803822 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-26162a8a-3874-4d3a-835b-313b8693cb68 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:53.804347 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-26162a8a-3874-4d3a-835b-313b8693cb68 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:54.041956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-26162a8a-3874-4d3a-835b-313b8693cb68 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:54.052848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-26162a8a-3874-4d3a-835b-313b8693cb68 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1577 microversion: 2.1 time: 0.267630 Apr 16 16:55:54.053789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 421/828] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:53 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1577 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:54.350952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-acef62a1-d329-420a-831a-c2a0c91227e6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:54.351728 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-acef62a1-d329-420a-831a-c2a0c91227e6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:54.361762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-acef62a1-d329-420a-831a-c2a0c91227e6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:54.362301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-acef62a1-d329-420a-831a-c2a0c91227e6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:54.363410 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-acef62a1-d329-420a-831a-c2a0c91227e6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:54.364117 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-acef62a1-d329-420a-831a-c2a0c91227e6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:54.378660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7c779f7d-4540-4701-a81c-de8b427a5a81 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:54.380079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7c779f7d-4540-4701-a81c-de8b427a5a81 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:54.389014 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7c779f7d-4540-4701-a81c-de8b427a5a81 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:54.389574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7c779f7d-4540-4701-a81c-de8b427a5a81 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:54.391316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7c779f7d-4540-4701-a81c-de8b427a5a81 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:54.391869 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7c779f7d-4540-4701-a81c-de8b427a5a81 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:54.512448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7c779f7d-4540-4701-a81c-de8b427a5a81 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 28712 microversion: 2.20 time: 0.138356 Apr 16 16:55:54.517901 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 422/829] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:54 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 28712 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:55:54.600498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-acef62a1-d329-420a-831a-c2a0c91227e6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:54.610363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-acef62a1-d329-420a-831a-c2a0c91227e6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1368 microversion: 2.1 time: 0.264118 Apr 16 16:55:54.611001 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 408/830] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:54 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:55.073863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0f36ca9e-799f-4a80-8bc6-932d58c462a0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:55.075059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0f36ca9e-799f-4a80-8bc6-932d58c462a0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:55.085446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f36ca9e-799f-4a80-8bc6-932d58c462a0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:55.086048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f36ca9e-799f-4a80-8bc6-932d58c462a0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:55.087000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f36ca9e-799f-4a80-8bc6-932d58c462a0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:55.087614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0f36ca9e-799f-4a80-8bc6-932d58c462a0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:55.347392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0f36ca9e-799f-4a80-8bc6-932d58c462a0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:55.356866 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0f36ca9e-799f-4a80-8bc6-932d58c462a0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1577 microversion: 2.1 time: 0.288197 Apr 16 16:55:55.357487 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 423/831] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:55 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1577 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:55.527287 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-68fe4048-ec9a-45c8-b0e3-b052c89cc389 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:55.528802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-68fe4048-ec9a-45c8-b0e3-b052c89cc389 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:55.542424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-7c1da6ac-51b1-4aca-bc8c-66ae90686a2b req-c8644f09-2f7f-47c9-8f4c-f8a9dadc83f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5", "name": "network-vif-plugged", "status": "completed", "tag": "ee6c6c28-4fef-436e-a001-4f66a8ffef9d"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:55.544306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:55:55.544306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:55:55.550719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-68fe4048-ec9a-45c8-b0e3-b052c89cc389 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:55.551301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-68fe4048-ec9a-45c8-b0e3-b052c89cc389 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:55.552232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-68fe4048-ec9a-45c8-b0e3-b052c89cc389 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:55.552771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-68fe4048-ec9a-45c8-b0e3-b052c89cc389 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:55.567602 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-7c1da6ac-51b1-4aca-bc8c-66ae90686a2b req-c8644f09-2f7f-47c9-8f4c-f8a9dadc83f0 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:55.567602 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-7c1da6ac-51b1-4aca-bc8c-66ae90686a2b req-c8644f09-2f7f-47c9-8f4c-f8a9dadc83f0 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:55.596447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-7c1da6ac-51b1-4aca-bc8c-66ae90686a2b req-c8644f09-2f7f-47c9-8f4c-f8a9dadc83f0 service nova] Creating event network-vif-plugged:ee6c6c28-4fef-436e-a001-4f66a8ffef9d for instance e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 on hv-cinder-73362 Apr 16 16:55:55.602923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-7c1da6ac-51b1-4aca-bc8c-66ae90686a2b req-c8644f09-2f7f-47c9-8f4c-f8a9dadc83f0 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064679 Apr 16 16:55:55.603807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 424/832] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:55:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:55:55.632054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-04f4d85b-0cde-4f0d-9120-2c2d59026d67 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:55.632956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-04f4d85b-0cde-4f0d-9120-2c2d59026d67 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:55.645682 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-04f4d85b-0cde-4f0d-9120-2c2d59026d67 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:55.646383 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-04f4d85b-0cde-4f0d-9120-2c2d59026d67 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:55.647434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-04f4d85b-0cde-4f0d-9120-2c2d59026d67 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:55.648829 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-04f4d85b-0cde-4f0d-9120-2c2d59026d67 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:55.697498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-68fe4048-ec9a-45c8-b0e3-b052c89cc389 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 29073 microversion: 2.20 time: 0.175122 Apr 16 16:55:55.699135 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 409/833] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:55 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 29073 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:55.887840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-04f4d85b-0cde-4f0d-9120-2c2d59026d67 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:55.897420 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-04f4d85b-0cde-4f0d-9120-2c2d59026d67 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1555 microversion: 2.1 time: 0.272609 Apr 16 16:55:55.898316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 425/834] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:55 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:55.917964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-27c46572-fd37-4589-86c3-ceabd2bab275 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:55.918961 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-27c46572-fd37-4589-86c3-ceabd2bab275 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:55.928330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27c46572-fd37-4589-86c3-ceabd2bab275 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:55.928837 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27c46572-fd37-4589-86c3-ceabd2bab275 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:55.929681 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27c46572-fd37-4589-86c3-ceabd2bab275 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:55.930186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-27c46572-fd37-4589-86c3-ceabd2bab275 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:56.135164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-27c46572-fd37-4589-86c3-ceabd2bab275 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.222282 Apr 16 16:55:56.135824 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 410/835] 10.222.0.103 () {58 vars in 1270 bytes} [Fri Apr 16 16:55:55 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-interface => generated 285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:55:56.378224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-83eea89d-09d2-492e-87db-3ec5a7b97c89 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:56.379044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-83eea89d-09d2-492e-87db-3ec5a7b97c89 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:56.387650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-83eea89d-09d2-492e-87db-3ec5a7b97c89 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:56.388154 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-83eea89d-09d2-492e-87db-3ec5a7b97c89 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:56.388996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-83eea89d-09d2-492e-87db-3ec5a7b97c89 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:56.389478 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-83eea89d-09d2-492e-87db-3ec5a7b97c89 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:56.712167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b793aac3-bf69-4159-95ba-6b3a3875b835 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:56.713215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b793aac3-bf69-4159-95ba-6b3a3875b835 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:56.722196 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b793aac3-bf69-4159-95ba-6b3a3875b835 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:56.722724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b793aac3-bf69-4159-95ba-6b3a3875b835 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:56.723575 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b793aac3-bf69-4159-95ba-6b3a3875b835 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:56.724069 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b793aac3-bf69-4159-95ba-6b3a3875b835 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:56.857619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b793aac3-bf69-4159-95ba-6b3a3875b835 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 30642 microversion: 2.20 time: 0.149439 Apr 16 16:55:56.858622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 411/836] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:56 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 30642 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:57.124987 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-83eea89d-09d2-492e-87db-3ec5a7b97c89 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:57.144498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-83eea89d-09d2-492e-87db-3ec5a7b97c89 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1577 microversion: 2.1 time: 0.771602 Apr 16 16:55:57.158851 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 426/837] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:56 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1577 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:57.871199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a180f6e4-0170-49be-9c8b-70d7047d211e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:57.872936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a180f6e4-0170-49be-9c8b-70d7047d211e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:57.883772 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a180f6e4-0170-49be-9c8b-70d7047d211e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:57.884273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a180f6e4-0170-49be-9c8b-70d7047d211e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:57.885120 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a180f6e4-0170-49be-9c8b-70d7047d211e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:57.885610 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a180f6e4-0170-49be-9c8b-70d7047d211e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:58.011370 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a180f6e4-0170-49be-9c8b-70d7047d211e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 32048 microversion: 2.20 time: 0.144421 Apr 16 16:55:58.012902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 412/838] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:57 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 32048 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:55:58.176619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-de30fbf5-3829-40b0-bd17-9abd201da0c0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:55:58.177592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-de30fbf5-3829-40b0-bd17-9abd201da0c0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:58.189627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-eeb28aa5-7b4f-4a04-94c3-d03e5c7a6722 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:58.191460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-eeb28aa5-7b4f-4a04-94c3-d03e5c7a6722 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:58.192477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de30fbf5-3829-40b0-bd17-9abd201da0c0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:58.192990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de30fbf5-3829-40b0-bd17-9abd201da0c0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:58.194130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de30fbf5-3829-40b0-bd17-9abd201da0c0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:58.194919 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de30fbf5-3829-40b0-bd17-9abd201da0c0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:58.202220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eeb28aa5-7b4f-4a04-94c3-d03e5c7a6722 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:58.203487 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eeb28aa5-7b4f-4a04-94c3-d03e5c7a6722 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:58.204331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eeb28aa5-7b4f-4a04-94c3-d03e5c7a6722 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:58.204932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-eeb28aa5-7b4f-4a04-94c3-d03e5c7a6722 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:58.375477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-eeb28aa5-7b4f-4a04-94c3-d03e5c7a6722 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.191375 Apr 16 16:55:58.380102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 413/839] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:55:58 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 16:55:58.386996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-a7272f75-a108-4a79-a53a-e3a1cf859ec1 req-ba06a47f-4b30-4d60-adfc-204cae5f0b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb2a15c6-8601-4a70-9281-a1259a155c9e", "tag": "5b904929-85e9-4626-bc83-c45200f69e9a"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:58.388773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:55:58.388773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:55:58.403528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-a7272f75-a108-4a79-a53a-e3a1cf859ec1 req-ba06a47f-4b30-4d60-adfc-204cae5f0b5e service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:58.404298 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-a7272f75-a108-4a79-a53a-e3a1cf859ec1 req-ba06a47f-4b30-4d60-adfc-204cae5f0b5e service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:58.424200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-a7272f75-a108-4a79-a53a-e3a1cf859ec1 req-ba06a47f-4b30-4d60-adfc-204cae5f0b5e service nova] Creating event network-changed:5b904929-85e9-4626-bc83-c45200f69e9a for instance eb2a15c6-8601-4a70-9281-a1259a155c9e on hv-cinder-73362 Apr 16 16:55:58.430229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-a7272f75-a108-4a79-a53a-e3a1cf859ec1 req-ba06a47f-4b30-4d60-adfc-204cae5f0b5e service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048138 Apr 16 16:55:58.431321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 414/840] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:55:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:55:58.538194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-de30fbf5-3829-40b0-bd17-9abd201da0c0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:55:58.551459 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-de30fbf5-3829-40b0-bd17-9abd201da0c0 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1564 microversion: 2.1 time: 0.381898 Apr 16 16:55:58.552594 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 427/841] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:55:58 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1564 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:55:59.026722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f12862b7-4a7e-43d2-b29c-258c2f9d1738 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:59.028512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f12862b7-4a7e-43d2-b29c-258c2f9d1738 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:59.066650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f12862b7-4a7e-43d2-b29c-258c2f9d1738 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:59.067029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f12862b7-4a7e-43d2-b29c-258c2f9d1738 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:59.067981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f12862b7-4a7e-43d2-b29c-258c2f9d1738 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:59.068478 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f12862b7-4a7e-43d2-b29c-258c2f9d1738 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:59.185890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f12862b7-4a7e-43d2-b29c-258c2f9d1738 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 33169 microversion: 2.20 time: 0.163037 Apr 16 16:55:59.188471 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 415/842] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:55:59 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 33169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:55:59.400482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1d530d5b-7f32-4dc7-9245-d52497fa2ae9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:55:59.402488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1d530d5b-7f32-4dc7-9245-d52497fa2ae9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:55:59.423105 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1d530d5b-7f32-4dc7-9245-d52497fa2ae9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:59.423634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1d530d5b-7f32-4dc7-9245-d52497fa2ae9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:59.429216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1d530d5b-7f32-4dc7-9245-d52497fa2ae9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:55:59.432114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1d530d5b-7f32-4dc7-9245-d52497fa2ae9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:55:59.558952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1d530d5b-7f32-4dc7-9245-d52497fa2ae9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.172841 Apr 16 16:55:59.559645 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 428/843] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:55:59 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:56:00.201017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7f886be1-47ab-444f-a7bd-ba503c6348a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:00.202210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7f886be1-47ab-444f-a7bd-ba503c6348a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:00.211936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7f886be1-47ab-444f-a7bd-ba503c6348a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:00.212447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7f886be1-47ab-444f-a7bd-ba503c6348a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:00.213301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7f886be1-47ab-444f-a7bd-ba503c6348a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:00.213913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7f886be1-47ab-444f-a7bd-ba503c6348a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:00.332177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7f886be1-47ab-444f-a7bd-ba503c6348a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 33853 microversion: 2.20 time: 0.135680 Apr 16 16:56:00.332888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 416/844] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:56:00 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 33853 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:56:00.571588 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4b67c55a-f848-497a-9d0c-5d467046c25e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:00.572860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4b67c55a-f848-497a-9d0c-5d467046c25e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:00.582528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4b67c55a-f848-497a-9d0c-5d467046c25e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:00.583007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4b67c55a-f848-497a-9d0c-5d467046c25e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:00.583840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4b67c55a-f848-497a-9d0c-5d467046c25e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:00.584324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4b67c55a-f848-497a-9d0c-5d467046c25e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:00.705674 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4b67c55a-f848-497a-9d0c-5d467046c25e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.138534 Apr 16 16:56:00.706446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 429/845] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:00 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:56:01.347876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8bf98df7-85b1-4ee1-a4e6-bf60c26ab600 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:01.349314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8bf98df7-85b1-4ee1-a4e6-bf60c26ab600 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:01.358229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bf98df7-85b1-4ee1-a4e6-bf60c26ab600 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:01.359150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bf98df7-85b1-4ee1-a4e6-bf60c26ab600 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:01.360767 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bf98df7-85b1-4ee1-a4e6-bf60c26ab600 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:01.361584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8bf98df7-85b1-4ee1-a4e6-bf60c26ab600 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:01.478862 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8bf98df7-85b1-4ee1-a4e6-bf60c26ab600 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 34815 microversion: 2.20 time: 0.136816 Apr 16 16:56:01.479677 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 417/846] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:56:01 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 34815 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:56:01.719293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7a31982a-ca47-4693-ade6-9fd6713a2337 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:01.721013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7a31982a-ca47-4693-ade6-9fd6713a2337 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:01.729430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7a31982a-ca47-4693-ade6-9fd6713a2337 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:01.729944 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7a31982a-ca47-4693-ade6-9fd6713a2337 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:01.730830 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7a31982a-ca47-4693-ade6-9fd6713a2337 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:01.731326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7a31982a-ca47-4693-ade6-9fd6713a2337 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:01.847141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7a31982a-ca47-4693-ade6-9fd6713a2337 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.132833 Apr 16 16:56:01.847853 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 430/847] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:01 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:56:02.493594 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6ac01aea-9727-4c1e-a266-466308e236b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:02.494860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6ac01aea-9727-4c1e-a266-466308e236b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:02.505237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ac01aea-9727-4c1e-a266-466308e236b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:02.505743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ac01aea-9727-4c1e-a266-466308e236b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:02.506634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ac01aea-9727-4c1e-a266-466308e236b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:02.507160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ac01aea-9727-4c1e-a266-466308e236b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:02.622777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6ac01aea-9727-4c1e-a266-466308e236b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 35615 microversion: 2.20 time: 0.134461 Apr 16 16:56:02.627941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 418/848] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:56:02 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 35615 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:56:02.860574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ace68796-08d9-4b45-8af2-efe655e9bef5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:02.861836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ace68796-08d9-4b45-8af2-efe655e9bef5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:02.870009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ace68796-08d9-4b45-8af2-efe655e9bef5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:02.870692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ace68796-08d9-4b45-8af2-efe655e9bef5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:02.871398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ace68796-08d9-4b45-8af2-efe655e9bef5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:02.871887 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ace68796-08d9-4b45-8af2-efe655e9bef5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:02.994836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ace68796-08d9-4b45-8af2-efe655e9bef5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.139953 Apr 16 16:56:02.995912 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 431/849] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:02 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:56:03.637122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4f0620d2-9fb0-43e3-80a0-b78e0c0a9a61 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:03.638474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4f0620d2-9fb0-43e3-80a0-b78e0c0a9a61 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:03.647427 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f0620d2-9fb0-43e3-80a0-b78e0c0a9a61 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:03.648188 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f0620d2-9fb0-43e3-80a0-b78e0c0a9a61 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:03.649026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f0620d2-9fb0-43e3-80a0-b78e0c0a9a61 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:03.649514 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f0620d2-9fb0-43e3-80a0-b78e0c0a9a61 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:03.762257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4f0620d2-9fb0-43e3-80a0-b78e0c0a9a61 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 36683 microversion: 2.20 time: 0.129560 Apr 16 16:56:03.763148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 419/850] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:56:03 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 36683 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:56:04.008260 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3eb3b2e5-70ad-4cf5-9271-add6eb109310 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:04.009714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3eb3b2e5-70ad-4cf5-9271-add6eb109310 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:04.018879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3eb3b2e5-70ad-4cf5-9271-add6eb109310 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:04.019535 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3eb3b2e5-70ad-4cf5-9271-add6eb109310 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:04.020378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3eb3b2e5-70ad-4cf5-9271-add6eb109310 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:04.020875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3eb3b2e5-70ad-4cf5-9271-add6eb109310 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:04.155342 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3eb3b2e5-70ad-4cf5-9271-add6eb109310 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.151531 Apr 16 16:56:04.156170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 432/851] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:04 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:56:04.778177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d3c98f95-1a34-4a39-acd4-fb5c75abb3fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:04.779512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d3c98f95-1a34-4a39-acd4-fb5c75abb3fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:04.789785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3c98f95-1a34-4a39-acd4-fb5c75abb3fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:04.790478 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3c98f95-1a34-4a39-acd4-fb5c75abb3fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:04.791329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3c98f95-1a34-4a39-acd4-fb5c75abb3fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:04.791820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3c98f95-1a34-4a39-acd4-fb5c75abb3fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:04.899851 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d3c98f95-1a34-4a39-acd4-fb5c75abb3fd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 37741 microversion: 2.20 time: 0.126830 Apr 16 16:56:04.900563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 420/852] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:56:04 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 37741 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:56:05.167922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d412ca5a-eb14-4d31-ab29-e08160ad6608 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:05.169229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d412ca5a-eb14-4d31-ab29-e08160ad6608 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:05.178178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d412ca5a-eb14-4d31-ab29-e08160ad6608 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:05.178746 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d412ca5a-eb14-4d31-ab29-e08160ad6608 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:05.179682 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d412ca5a-eb14-4d31-ab29-e08160ad6608 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:05.180222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d412ca5a-eb14-4d31-ab29-e08160ad6608 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:05.285417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d412ca5a-eb14-4d31-ab29-e08160ad6608 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.121994 Apr 16 16:56:05.286442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 433/853] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:05 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:56:05.914337 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c29d9d6d-ded1-4a64-b9dc-5ee9bb9412c1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:05.915442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c29d9d6d-ded1-4a64-b9dc-5ee9bb9412c1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:05.924748 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c29d9d6d-ded1-4a64-b9dc-5ee9bb9412c1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:05.925249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c29d9d6d-ded1-4a64-b9dc-5ee9bb9412c1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:05.926088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c29d9d6d-ded1-4a64-b9dc-5ee9bb9412c1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:05.926628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c29d9d6d-ded1-4a64-b9dc-5ee9bb9412c1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:06.058005 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c29d9d6d-ded1-4a64-b9dc-5ee9bb9412c1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 38256 microversion: 2.20 time: 0.148224 Apr 16 16:56:06.058755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 421/854] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:56:05 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 38256 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:56:06.298638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3d8ebc1a-f661-40bf-abf2-551f7b20ee43 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:06.299786 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3d8ebc1a-f661-40bf-abf2-551f7b20ee43 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:06.308747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d8ebc1a-f661-40bf-abf2-551f7b20ee43 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:06.309262 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d8ebc1a-f661-40bf-abf2-551f7b20ee43 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:06.310115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d8ebc1a-f661-40bf-abf2-551f7b20ee43 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:06.310884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d8ebc1a-f661-40bf-abf2-551f7b20ee43 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:06.424570 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3d8ebc1a-f661-40bf-abf2-551f7b20ee43 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.130352 Apr 16 16:56:06.425275 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 434/855] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:06 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:56:07.072055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-20ff7c2b-917d-46b7-af6e-a40ff76a2449 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:07.073831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-20ff7c2b-917d-46b7-af6e-a40ff76a2449 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:07.083018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20ff7c2b-917d-46b7-af6e-a40ff76a2449 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:07.083516 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20ff7c2b-917d-46b7-af6e-a40ff76a2449 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:07.084440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20ff7c2b-917d-46b7-af6e-a40ff76a2449 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:07.084920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20ff7c2b-917d-46b7-af6e-a40ff76a2449 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:07.201303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-20ff7c2b-917d-46b7-af6e-a40ff76a2449 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 38256 microversion: 2.20 time: 0.133766 Apr 16 16:56:07.202022 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 422/856] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:56:07 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 38256 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:56:07.437199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3dfbc966-da67-4ba0-90f7-710366574683 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:07.438378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3dfbc966-da67-4ba0-90f7-710366574683 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:07.447224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3dfbc966-da67-4ba0-90f7-710366574683 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:07.447730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3dfbc966-da67-4ba0-90f7-710366574683 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:07.448596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3dfbc966-da67-4ba0-90f7-710366574683 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:07.449087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3dfbc966-da67-4ba0-90f7-710366574683 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:07.552020 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3dfbc966-da67-4ba0-90f7-710366574683 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.119370 Apr 16 16:56:07.552632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 435/857] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:07 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:56:08.214922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2cdf5026-ffec-4f35-ba93-5051c6d3e10c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:08.216059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2cdf5026-ffec-4f35-ba93-5051c6d3e10c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:08.225620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2cdf5026-ffec-4f35-ba93-5051c6d3e10c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:08.226131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2cdf5026-ffec-4f35-ba93-5051c6d3e10c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:08.227028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2cdf5026-ffec-4f35-ba93-5051c6d3e10c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:08.227521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2cdf5026-ffec-4f35-ba93-5051c6d3e10c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:08.564782 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f742321d-2350-4484-91c7-2c8584df782f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:08.565930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f742321d-2350-4484-91c7-2c8584df782f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:08.574603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f742321d-2350-4484-91c7-2c8584df782f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:08.575122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f742321d-2350-4484-91c7-2c8584df782f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:08.575982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f742321d-2350-4484-91c7-2c8584df782f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:08.576651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f742321d-2350-4484-91c7-2c8584df782f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:10.712529 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2cdf5026-ffec-4f35-ba93-5051c6d3e10c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 200 len: 38398 microversion: 2.20 time: 2.502117 Apr 16 16:56:10.713360 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 423/858] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:56:08 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 38398 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:56:10.718043 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f742321d-2350-4484-91c7-2c8584df782f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 2.157817 Apr 16 16:56:10.719046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 436/859] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:08 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 16:56:10.728040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-091a5e12-164b-4bbd-8d7c-dcfba62824c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:10.728040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-091a5e12-164b-4bbd-8d7c-dcfba62824c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:10.743090 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-091a5e12-164b-4bbd-8d7c-dcfba62824c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:10.743595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-091a5e12-164b-4bbd-8d7c-dcfba62824c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:10.744449 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-091a5e12-164b-4bbd-8d7c-dcfba62824c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:10.744932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-091a5e12-164b-4bbd-8d7c-dcfba62824c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:10.826521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-091a5e12-164b-4bbd-8d7c-dcfba62824c2 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/ips" status: 200 len: 152 microversion: 2.20 time: 0.103405 Apr 16 16:56:10.826521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 424/860] 10.222.0.103 () {60 vars in 1284 bytes} [Fri Apr 16 16:56:10 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/ips => generated 152 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:11.730441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ab8324c7-bd6f-4a46-a4ad-00dcff1e9975 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:11.731621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ab8324c7-bd6f-4a46-a4ad-00dcff1e9975 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:11.740976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ab8324c7-bd6f-4a46-a4ad-00dcff1e9975 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:11.741481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ab8324c7-bd6f-4a46-a4ad-00dcff1e9975 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:11.742366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ab8324c7-bd6f-4a46-a4ad-00dcff1e9975 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:11.742865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ab8324c7-bd6f-4a46-a4ad-00dcff1e9975 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:11.853618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ab8324c7-bd6f-4a46-a4ad-00dcff1e9975 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.127668 Apr 16 16:56:11.854366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 437/861] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:11 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:56:12.866479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c1790af8-41fe-4804-8c11-b67637577c14 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:12.867517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c1790af8-41fe-4804-8c11-b67637577c14 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:12.876943 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1790af8-41fe-4804-8c11-b67637577c14 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:12.877444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1790af8-41fe-4804-8c11-b67637577c14 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:12.878326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1790af8-41fe-4804-8c11-b67637577c14 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:12.878814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c1790af8-41fe-4804-8c11-b67637577c14 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:13.006790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c1790af8-41fe-4804-8c11-b67637577c14 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 4832 microversion: 2.1 time: 0.144092 Apr 16 16:56:13.010837 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 425/862] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:12 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 4832 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:13.734192 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c73b5702-d1f8-44ff-9e14-e6f3571a2dcf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:13.734977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c73b5702-d1f8-44ff-9e14-e6f3571a2dcf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:13.745060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c73b5702-d1f8-44ff-9e14-e6f3571a2dcf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:13.745637 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c73b5702-d1f8-44ff-9e14-e6f3571a2dcf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:13.746708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c73b5702-d1f8-44ff-9e14-e6f3571a2dcf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:13.747251 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c73b5702-d1f8-44ff-9e14-e6f3571a2dcf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:13.816931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-c73b5702-d1f8-44ff-9e14-e6f3571a2dcf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lazy-loading 'flavor' on Instance uuid 4a606efe-c285-436f-9d27-d09708bc4564 {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:56:14.021840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-945a7ded-b47d-4897-b3e8-fb86e2c1ff6f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:14.023431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-945a7ded-b47d-4897-b3e8-fb86e2c1ff6f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:14.047776 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-945a7ded-b47d-4897-b3e8-fb86e2c1ff6f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:14.048441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-945a7ded-b47d-4897-b3e8-fb86e2c1ff6f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:14.049333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-945a7ded-b47d-4897-b3e8-fb86e2c1ff6f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:14.049834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-945a7ded-b47d-4897-b3e8-fb86e2c1ff6f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:14.212119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-945a7ded-b47d-4897-b3e8-fb86e2c1ff6f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 12286 microversion: 2.1 time: 0.194654 Apr 16 16:56:14.212915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 426/863] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:14 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 12286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:56:14.245718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c73b5702-d1f8-44ff-9e14-e6f3571a2dcf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 202 len: 0 microversion: 2.20 time: 0.516536 Apr 16 16:56:14.246549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 438/864] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:56:13 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:56:14.256973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0ebfff9f-6fae-49f0-a217-d4d115e076e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:14.257830 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0ebfff9f-6fae-49f0-a217-d4d115e076e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:14.268307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ebfff9f-6fae-49f0-a217-d4d115e076e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:14.268818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ebfff9f-6fae-49f0-a217-d4d115e076e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:14.269693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ebfff9f-6fae-49f0-a217-d4d115e076e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:14.270262 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0ebfff9f-6fae-49f0-a217-d4d115e076e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:14.506313 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0ebfff9f-6fae-49f0-a217-d4d115e076e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:14.517758 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0ebfff9f-6fae-49f0-a217-d4d115e076e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:14.519521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0ebfff9f-6fae-49f0-a217-d4d115e076e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:14.520795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0ebfff9f-6fae-49f0-a217-d4d115e076e9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.269276 Apr 16 16:56:14.521430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 427/865] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:14 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:15.228648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c3136b60-c415-4400-a99d-c0b786a005ba tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:15.230236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c3136b60-c415-4400-a99d-c0b786a005ba tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:15.243011 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c3136b60-c415-4400-a99d-c0b786a005ba tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:15.243620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c3136b60-c415-4400-a99d-c0b786a005ba tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:15.244663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c3136b60-c415-4400-a99d-c0b786a005ba tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:15.245353 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c3136b60-c415-4400-a99d-c0b786a005ba tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:15.373568 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c3136b60-c415-4400-a99d-c0b786a005ba tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 17250 microversion: 2.1 time: 0.151206 Apr 16 16:56:15.375366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 439/866] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:15 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 17250 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:15.542511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ddb0f55d-1e51-4961-843a-e6661a99d86b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:15.543202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ddb0f55d-1e51-4961-843a-e6661a99d86b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:15.552205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ddb0f55d-1e51-4961-843a-e6661a99d86b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:15.552743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ddb0f55d-1e51-4961-843a-e6661a99d86b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:15.553646 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ddb0f55d-1e51-4961-843a-e6661a99d86b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:15.554133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ddb0f55d-1e51-4961-843a-e6661a99d86b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:15.787364 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ddb0f55d-1e51-4961-843a-e6661a99d86b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:15.798349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ddb0f55d-1e51-4961-843a-e6661a99d86b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:15.800051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ddb0f55d-1e51-4961-843a-e6661a99d86b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:15.801281 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ddb0f55d-1e51-4961-843a-e6661a99d86b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.263219 Apr 16 16:56:15.801900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 428/867] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:15 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:16.387692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-53c5d74a-64d7-482f-bf16-7625d5391f2a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:16.388811 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-53c5d74a-64d7-482f-bf16-7625d5391f2a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:16.398936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-53c5d74a-64d7-482f-bf16-7625d5391f2a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:16.399446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-53c5d74a-64d7-482f-bf16-7625d5391f2a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:16.400297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-53c5d74a-64d7-482f-bf16-7625d5391f2a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:16.400788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-53c5d74a-64d7-482f-bf16-7625d5391f2a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:16.531860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-53c5d74a-64d7-482f-bf16-7625d5391f2a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 17861 microversion: 2.1 time: 0.147028 Apr 16 16:56:16.534809 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 440/868] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:16 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 17861 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:16.821769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b5f687bc-3ac7-4b83-a0d2-69cb1b728794 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:16.822896 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b5f687bc-3ac7-4b83-a0d2-69cb1b728794 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:16.833017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5f687bc-3ac7-4b83-a0d2-69cb1b728794 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:16.833558 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5f687bc-3ac7-4b83-a0d2-69cb1b728794 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:16.834564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5f687bc-3ac7-4b83-a0d2-69cb1b728794 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:16.835096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b5f687bc-3ac7-4b83-a0d2-69cb1b728794 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:17.076191 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b5f687bc-3ac7-4b83-a0d2-69cb1b728794 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:17.088606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b5f687bc-3ac7-4b83-a0d2-69cb1b728794 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:17.091358 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b5f687bc-3ac7-4b83-a0d2-69cb1b728794 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:17.093282 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b5f687bc-3ac7-4b83-a0d2-69cb1b728794 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.275713 Apr 16 16:56:17.094409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 429/869] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:16 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:17.549823 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3c1e17d8-6d59-4472-891a-95388b040c97 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:17.551680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3c1e17d8-6d59-4472-891a-95388b040c97 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:17.566933 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c1e17d8-6d59-4472-891a-95388b040c97 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:17.567782 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c1e17d8-6d59-4472-891a-95388b040c97 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:17.569190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c1e17d8-6d59-4472-891a-95388b040c97 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:17.569995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c1e17d8-6d59-4472-891a-95388b040c97 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:17.697752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3c1e17d8-6d59-4472-891a-95388b040c97 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 19342 microversion: 2.1 time: 0.156368 Apr 16 16:56:17.698343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 441/870] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:17 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 19342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:18.115378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7b6467af-30b2-42c6-9029-23b0886ec64b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:18.116209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7b6467af-30b2-42c6-9029-23b0886ec64b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:18.126137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b6467af-30b2-42c6-9029-23b0886ec64b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:18.126681 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b6467af-30b2-42c6-9029-23b0886ec64b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:18.127545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b6467af-30b2-42c6-9029-23b0886ec64b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:18.128087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7b6467af-30b2-42c6-9029-23b0886ec64b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:18.375650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7b6467af-30b2-42c6-9029-23b0886ec64b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:18.385572 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7b6467af-30b2-42c6-9029-23b0886ec64b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:18.387824 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7b6467af-30b2-42c6-9029-23b0886ec64b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:18.389469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7b6467af-30b2-42c6-9029-23b0886ec64b tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.279023 Apr 16 16:56:18.390714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 430/871] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:18 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:18.711208 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-31f38ccb-92eb-48d3-8974-9bb0b1b54c45 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:18.712398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-31f38ccb-92eb-48d3-8974-9bb0b1b54c45 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:18.723290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-31f38ccb-92eb-48d3-8974-9bb0b1b54c45 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:18.723868 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-31f38ccb-92eb-48d3-8974-9bb0b1b54c45 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:18.724874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-31f38ccb-92eb-48d3-8974-9bb0b1b54c45 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:18.725374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-31f38ccb-92eb-48d3-8974-9bb0b1b54c45 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:18.843623 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-31f38ccb-92eb-48d3-8974-9bb0b1b54c45 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 21678 microversion: 2.1 time: 0.136343 Apr 16 16:56:18.844781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 442/872] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:18 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 21678 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:19.130318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b9d62090-c846-4f1e-8aab-971bf7fe345a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:19.130881 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b9d62090-c846-4f1e-8aab-971bf7fe345a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:19.138889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9d62090-c846-4f1e-8aab-971bf7fe345a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:19.139392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9d62090-c846-4f1e-8aab-971bf7fe345a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:19.140785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9d62090-c846-4f1e-8aab-971bf7fe345a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:19.141271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9d62090-c846-4f1e-8aab-971bf7fe345a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:19.213436 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b9d62090-c846-4f1e-8aab-971bf7fe345a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Going to try to terminate instance {{(pid=99399) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:56:19.344879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b9d62090-c846-4f1e-8aab-971bf7fe345a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "DELETE /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 204 len: 0 microversion: 2.1 time: 0.218120 Apr 16 16:56:19.345917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 431/873] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:56:19 2021] DELETE /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:56:19.357602 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7f58fa35-1870-4bc8-869b-f7a1fdb0c597 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:19.358563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7f58fa35-1870-4bc8-869b-f7a1fdb0c597 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:19.370367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7f58fa35-1870-4bc8-869b-f7a1fdb0c597 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:19.370925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7f58fa35-1870-4bc8-869b-f7a1fdb0c597 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:19.371561 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7f58fa35-1870-4bc8-869b-f7a1fdb0c597 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:19.372122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7f58fa35-1870-4bc8-869b-f7a1fdb0c597 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:19.414791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-08ace515-b303-4b38-8f81-9375ed3608f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:19.415662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-08ace515-b303-4b38-8f81-9375ed3608f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:19.424734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08ace515-b303-4b38-8f81-9375ed3608f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:19.424734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08ace515-b303-4b38-8f81-9375ed3608f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:19.426503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08ace515-b303-4b38-8f81-9375ed3608f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:19.426503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08ace515-b303-4b38-8f81-9375ed3608f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:19.738525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7f58fa35-1870-4bc8-869b-f7a1fdb0c597 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:19.746689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-08ace515-b303-4b38-8f81-9375ed3608f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:19.752082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7f58fa35-1870-4bc8-869b-f7a1fdb0c597 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1579 microversion: 2.1 time: 0.399462 Apr 16 16:56:19.752781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 443/874] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:19 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1579 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:19.758216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-08ace515-b303-4b38-8f81-9375ed3608f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:19.759932 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-08ace515-b303-4b38-8f81-9375ed3608f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:19.761162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-08ace515-b303-4b38-8f81-9375ed3608f8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.353050 Apr 16 16:56:19.762085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 432/875] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:19 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:19.856308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-faaa9b59-e021-437f-9676-b01459f9deff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:19.857617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-faaa9b59-e021-437f-9676-b01459f9deff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:19.867633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-faaa9b59-e021-437f-9676-b01459f9deff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:19.868134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-faaa9b59-e021-437f-9676-b01459f9deff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:19.869072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-faaa9b59-e021-437f-9676-b01459f9deff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:19.869669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-faaa9b59-e021-437f-9676-b01459f9deff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:19.996854 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-faaa9b59-e021-437f-9676-b01459f9deff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 22880 microversion: 2.1 time: 0.144720 Apr 16 16:56:19.997779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 444/876] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:19 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 22880 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:20.773679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-60958aa9-6889-454c-a4a9-8a3874720582 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:20.775014 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-60958aa9-6889-454c-a4a9-8a3874720582 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:20.785102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-29b82aed-316d-4df0-8c95-bc58cf5aa79d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:20.785670 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60958aa9-6889-454c-a4a9-8a3874720582 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:20.786599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60958aa9-6889-454c-a4a9-8a3874720582 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:20.787180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-29b82aed-316d-4df0-8c95-bc58cf5aa79d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:20.787729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60958aa9-6889-454c-a4a9-8a3874720582 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:20.788485 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60958aa9-6889-454c-a4a9-8a3874720582 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:20.798508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29b82aed-316d-4df0-8c95-bc58cf5aa79d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:20.798965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29b82aed-316d-4df0-8c95-bc58cf5aa79d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:20.799814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29b82aed-316d-4df0-8c95-bc58cf5aa79d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:20.800303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-29b82aed-316d-4df0-8c95-bc58cf5aa79d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:21.390455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-60958aa9-6889-454c-a4a9-8a3874720582 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:21.397878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-29b82aed-316d-4df0-8c95-bc58cf5aa79d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:21.402388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-60958aa9-6889-454c-a4a9-8a3874720582 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1579 microversion: 2.1 time: 0.633560 Apr 16 16:56:21.403099 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 433/877] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:20 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1579 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:21.408510 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e3635c4f-56b6-4b8a-8785-432eed2a2d22 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:21.408688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-29b82aed-316d-4df0-8c95-bc58cf5aa79d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:21.409854 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e3635c4f-56b6-4b8a-8785-432eed2a2d22 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:21.410229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-29b82aed-316d-4df0-8c95-bc58cf5aa79d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:21.411505 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-29b82aed-316d-4df0-8c95-bc58cf5aa79d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.632584 Apr 16 16:56:21.412094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 445/878] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:20 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:56:21.418596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3635c4f-56b6-4b8a-8785-432eed2a2d22 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:21.418983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3635c4f-56b6-4b8a-8785-432eed2a2d22 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:21.419790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3635c4f-56b6-4b8a-8785-432eed2a2d22 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:21.420272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3635c4f-56b6-4b8a-8785-432eed2a2d22 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:21.543642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e3635c4f-56b6-4b8a-8785-432eed2a2d22 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 23486 microversion: 2.1 time: 0.138845 Apr 16 16:56:21.545826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 434/879] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:21 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 23486 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:22.423022 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d4af97be-9e4f-4a83-ac48-52c0758cccd4 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:22.423707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d4af97be-9e4f-4a83-ac48-52c0758cccd4 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:22.434501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4af97be-9e4f-4a83-ac48-52c0758cccd4 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:22.434924 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ef054af5-278a-4d5f-a2de-39be2d4b6472 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:22.435041 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4af97be-9e4f-4a83-ac48-52c0758cccd4 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:22.435573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ef054af5-278a-4d5f-a2de-39be2d4b6472 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:22.435915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4af97be-9e4f-4a83-ac48-52c0758cccd4 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:22.436550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4af97be-9e4f-4a83-ac48-52c0758cccd4 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:22.445304 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef054af5-278a-4d5f-a2de-39be2d4b6472 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:22.445810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef054af5-278a-4d5f-a2de-39be2d4b6472 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:22.446701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef054af5-278a-4d5f-a2de-39be2d4b6472 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:22.447202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ef054af5-278a-4d5f-a2de-39be2d4b6472 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:23.068858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ef054af5-278a-4d5f-a2de-39be2d4b6472 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:23.079998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ef054af5-278a-4d5f-a2de-39be2d4b6472 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:23.081684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ef054af5-278a-4d5f-a2de-39be2d4b6472 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:23.082962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ef054af5-278a-4d5f-a2de-39be2d4b6472 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.652764 Apr 16 16:56:23.083585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 435/880] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:22 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:56:23.088638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7bb9a894-1083-4937-9d4c-f95853c040f8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:23.089836 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7bb9a894-1083-4937-9d4c-f95853c040f8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:23.098270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d4af97be-9e4f-4a83-ac48-52c0758cccd4 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:23.103475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7bb9a894-1083-4937-9d4c-f95853c040f8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:23.103972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7bb9a894-1083-4937-9d4c-f95853c040f8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:23.104812 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7bb9a894-1083-4937-9d4c-f95853c040f8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:23.105293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7bb9a894-1083-4937-9d4c-f95853c040f8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:23.112018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d4af97be-9e4f-4a83-ac48-52c0758cccd4 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1579 microversion: 2.1 time: 0.694340 Apr 16 16:56:23.112730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 446/881] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:22 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1579 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:23.269349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7bb9a894-1083-4937-9d4c-f95853c040f8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 24662 microversion: 2.1 time: 0.184234 Apr 16 16:56:23.270166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 436/882] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:23 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 24662 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:23.733078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-69e0e41c-c19a-4ce3-9b28-f5a955fe3005 req-f0fe4295-cf2f-45e2-a22f-b67b8d1b350d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954b9698-4e4c-4bd2-9cba-021819421e40", "name": "network-vif-deleted", "tag": "c82bdbb9-8da8-4836-a28f-01855d319f56"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:23.736091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:56:23.736091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:56:23.747377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-69e0e41c-c19a-4ce3-9b28-f5a955fe3005 req-f0fe4295-cf2f-45e2-a22f-b67b8d1b350d service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:23.747880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-69e0e41c-c19a-4ce3-9b28-f5a955fe3005 req-f0fe4295-cf2f-45e2-a22f-b67b8d1b350d service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:23.944155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-69e0e41c-c19a-4ce3-9b28-f5a955fe3005 req-f0fe4295-cf2f-45e2-a22f-b67b8d1b350d service nova] Creating event network-vif-deleted:c82bdbb9-8da8-4836-a28f-01855d319f56 for instance 954b9698-4e4c-4bd2-9cba-021819421e40 on hv-cinder-73362 Apr 16 16:56:23.949615 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-69e0e41c-c19a-4ce3-9b28-f5a955fe3005 req-f0fe4295-cf2f-45e2-a22f-b67b8d1b350d service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221509 Apr 16 16:56:23.950246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 447/883] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:56:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:56:24.113237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-aeec8286-2c1e-49cc-9dc9-479ec4245651 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:24.113936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-aeec8286-2c1e-49cc-9dc9-479ec4245651 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:24.123162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aeec8286-2c1e-49cc-9dc9-479ec4245651 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:24.123724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aeec8286-2c1e-49cc-9dc9-479ec4245651 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:24.124705 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aeec8286-2c1e-49cc-9dc9-479ec4245651 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:24.125214 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aeec8286-2c1e-49cc-9dc9-479ec4245651 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:24.142089 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e88aa1ec-dda7-419f-bbd0-5d84d12d5de1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:24.143159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e88aa1ec-dda7-419f-bbd0-5d84d12d5de1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:24.151869 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e88aa1ec-dda7-419f-bbd0-5d84d12d5de1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:24.152644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e88aa1ec-dda7-419f-bbd0-5d84d12d5de1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:24.153498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e88aa1ec-dda7-419f-bbd0-5d84d12d5de1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:24.153994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e88aa1ec-dda7-419f-bbd0-5d84d12d5de1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:24.422508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e88aa1ec-dda7-419f-bbd0-5d84d12d5de1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:24.433150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e88aa1ec-dda7-419f-bbd0-5d84d12d5de1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 200 len: 1228 microversion: 2.1 time: 0.296717 Apr 16 16:56:24.445874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 448/884] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:24 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 1228 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:56:24.445874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d0d4c812-9133-4fe6-9728-ff5b4e411ae8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:24.445874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d0d4c812-9133-4fe6-9728-ff5b4e411ae8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:24.449682 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d0d4c812-9133-4fe6-9728-ff5b4e411ae8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:24.450197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d0d4c812-9133-4fe6-9728-ff5b4e411ae8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:24.451094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d0d4c812-9133-4fe6-9728-ff5b4e411ae8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:24.451629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d0d4c812-9133-4fe6-9728-ff5b4e411ae8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:24.518691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-aeec8286-2c1e-49cc-9dc9-479ec4245651 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:24.530119 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-aeec8286-2c1e-49cc-9dc9-479ec4245651 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:24.532047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-aeec8286-2c1e-49cc-9dc9-479ec4245651 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:24.533462 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-aeec8286-2c1e-49cc-9dc9-479ec4245651 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.426325 Apr 16 16:56:24.534341 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 437/885] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:24 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:24.600518 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d0d4c812-9133-4fe6-9728-ff5b4e411ae8 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 25775 microversion: 2.1 time: 0.165262 Apr 16 16:56:24.601208 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 449/886] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:24 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 25775 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:25.455505 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-709bfa5e-5f1d-4813-951e-d749dbf62bfd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:25.456178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-709bfa5e-5f1d-4813-951e-d749dbf62bfd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:25.464787 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-709bfa5e-5f1d-4813-951e-d749dbf62bfd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:25.465292 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-709bfa5e-5f1d-4813-951e-d749dbf62bfd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:25.466142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-709bfa5e-5f1d-4813-951e-d749dbf62bfd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:25.466781 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-709bfa5e-5f1d-4813-951e-d749dbf62bfd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:25.525098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-709bfa5e-5f1d-4813-951e-d749dbf62bfd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] HTTP exception thrown: Instance 954b9698-4e4c-4bd2-9cba-021819421e40 could not be found. Apr 16 16:56:25.525766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-709bfa5e-5f1d-4813-951e-d749dbf62bfd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Returning 404 to user: Instance 954b9698-4e4c-4bd2-9cba-021819421e40 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:56:25.526857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-709bfa5e-5f1d-4813-951e-d749dbf62bfd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 404 len: 111 microversion: 2.1 time: 0.076804 Apr 16 16:56:25.527491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 438/887] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:25 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:56:25.561251 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8fe33c43-fe3e-45eb-ae30-29df1396780f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:25.562091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8fe33c43-fe3e-45eb-ae30-29df1396780f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:25.579441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8fe33c43-fe3e-45eb-ae30-29df1396780f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:25.580431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8fe33c43-fe3e-45eb-ae30-29df1396780f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:25.581982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8fe33c43-fe3e-45eb-ae30-29df1396780f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:25.582990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8fe33c43-fe3e-45eb-ae30-29df1396780f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:25.618818 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6d3e2134-26fa-408c-a2ea-dba94d696ad5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:25.620268 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6d3e2134-26fa-408c-a2ea-dba94d696ad5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:25.630511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6d3e2134-26fa-408c-a2ea-dba94d696ad5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:25.631342 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6d3e2134-26fa-408c-a2ea-dba94d696ad5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:25.632345 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6d3e2134-26fa-408c-a2ea-dba94d696ad5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:25.632991 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6d3e2134-26fa-408c-a2ea-dba94d696ad5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:25.765969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6d3e2134-26fa-408c-a2ea-dba94d696ad5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 26463 microversion: 2.1 time: 0.155189 Apr 16 16:56:25.766905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 439/888] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:25 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 26463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:25.773446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1274963377", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-680428694", "security_groups": [{"name": "tempest-secgroup-smoke-162326361"}], "block_device_mapping_v2": [{"uuid": "586e14dd-e1e5-428c-909a-51442e32e974", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4fdfd20a-86ba-40ff-badd-033e171b120f"}]}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:25.926867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8fe33c43-fe3e-45eb-ae30-29df1396780f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:25.940185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8fe33c43-fe3e-45eb-ae30-29df1396780f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:25.941858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8fe33c43-fe3e-45eb-ae30-29df1396780f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:25.943114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8fe33c43-fe3e-45eb-ae30-29df1396780f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.392486 Apr 16 16:56:25.943724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 450/889] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:25 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:25.998129 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] validate_networks() for [('4fdfd20a-86ba-40ff-badd-033e171b120f', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:56:26.782501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f14b04ed-0dff-4bc6-a979-a948e468d76c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:26.785118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f14b04ed-0dff-4bc6-a979-a948e468d76c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:26.798136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f14b04ed-0dff-4bc6-a979-a948e468d76c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:26.798689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f14b04ed-0dff-4bc6-a979-a948e468d76c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:26.799574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f14b04ed-0dff-4bc6-a979-a948e468d76c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:26.800074 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f14b04ed-0dff-4bc6-a979-a948e468d76c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:26.934058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f14b04ed-0dff-4bc6-a979-a948e468d76c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 27104 microversion: 2.1 time: 0.157421 Apr 16 16:56:26.935035 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 451/890] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:26 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 27104 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:56:26.938220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:56:26.938756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:56:26.939294 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:56:26.939793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:56:26.940241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:56:26.949966 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:26.950578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:26.951503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:26.952042 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:26.971766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-790ed18a-8dae-4102-8fe6-834d7b5a33aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:26.971766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-790ed18a-8dae-4102-8fe6-834d7b5a33aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:26.974671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Getting quotas for project 215e50567539412caa22fd5000dc74a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:56:26.979226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-790ed18a-8dae-4102-8fe6-834d7b5a33aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:26.979865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-790ed18a-8dae-4102-8fe6-834d7b5a33aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:26.980343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Getting quotas for user 33d512498d26488895520590b4b2ea1d and project 215e50567539412caa22fd5000dc74a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:56:26.980998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-790ed18a-8dae-4102-8fe6-834d7b5a33aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:26.981496 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-790ed18a-8dae-4102-8fe6-834d7b5a33aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:27.173728 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:56:27.179022 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='586e14dd-e1e5-428c-909a-51442e32e974',volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:56:27.272509 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-790ed18a-8dae-4102-8fe6-834d7b5a33aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:27.287882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-790ed18a-8dae-4102-8fe6-834d7b5a33aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:27.289614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-790ed18a-8dae-4102-8fe6-834d7b5a33aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:27.291052 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-790ed18a-8dae-4102-8fe6-834d7b5a33aa tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.329094 Apr 16 16:56:27.292083 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 452/891] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:26 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:27.460618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0cb19bdb-512c-4b4d-b121-792b0f65cdfc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.692283 Apr 16 16:56:27.461337 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 440/892] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:56:25 2021] POST /compute/v2.1/servers => generated 407 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:56:27.477921 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-09afc403-8956-48de-96dd-5eda60169167 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:27.478730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-09afc403-8956-48de-96dd-5eda60169167 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:27.584374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-09afc403-8956-48de-96dd-5eda60169167 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:27.593700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-09afc403-8956-48de-96dd-5eda60169167 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1097 microversion: 2.1 time: 0.120245 Apr 16 16:56:27.594376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 453/893] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:27 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1097 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:27.947763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d92e155a-e6e8-4d04-b248-519fefbb3920 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:27.949032 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d92e155a-e6e8-4d04-b248-519fefbb3920 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:27.959315 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d92e155a-e6e8-4d04-b248-519fefbb3920 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:27.959824 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d92e155a-e6e8-4d04-b248-519fefbb3920 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:27.960617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d92e155a-e6e8-4d04-b248-519fefbb3920 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:27.961114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d92e155a-e6e8-4d04-b248-519fefbb3920 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:28.081155 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d92e155a-e6e8-4d04-b248-519fefbb3920 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 27629 microversion: 2.1 time: 0.137318 Apr 16 16:56:28.081908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 441/894] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:27 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 27629 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:28.323038 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f257e8ef-2239-464b-99b9-919c1ef438b8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:28.324002 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f257e8ef-2239-464b-99b9-919c1ef438b8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:28.334019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f257e8ef-2239-464b-99b9-919c1ef438b8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:28.334556 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f257e8ef-2239-464b-99b9-919c1ef438b8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:28.335419 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f257e8ef-2239-464b-99b9-919c1ef438b8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:28.335938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f257e8ef-2239-464b-99b9-919c1ef438b8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:28.579816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f257e8ef-2239-464b-99b9-919c1ef438b8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:28.592179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f257e8ef-2239-464b-99b9-919c1ef438b8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:28.594885 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f257e8ef-2239-464b-99b9-919c1ef438b8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:28.596278 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f257e8ef-2239-464b-99b9-919c1ef438b8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.278128 Apr 16 16:56:28.596888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 454/895] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:28 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:28.614267 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-474cf680-b4ec-4bdc-a015-1f399eba1ce9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:28.615172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-474cf680-b4ec-4bdc-a015-1f399eba1ce9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:28.625374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-474cf680-b4ec-4bdc-a015-1f399eba1ce9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:28.625718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-474cf680-b4ec-4bdc-a015-1f399eba1ce9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:28.626771 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-474cf680-b4ec-4bdc-a015-1f399eba1ce9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:28.627243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-474cf680-b4ec-4bdc-a015-1f399eba1ce9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:28.802116 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-474cf680-b4ec-4bdc-a015-1f399eba1ce9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:28.821639 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-474cf680-b4ec-4bdc-a015-1f399eba1ce9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1195 microversion: 2.1 time: 0.212740 Apr 16 16:56:28.822633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 442/896] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:28 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1195 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:56:29.095507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a8dc9878-d997-4ca9-bde3-4daf78f49925 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:29.096610 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a8dc9878-d997-4ca9-bde3-4daf78f49925 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:29.106150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a8dc9878-d997-4ca9-bde3-4daf78f49925 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:29.106721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a8dc9878-d997-4ca9-bde3-4daf78f49925 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:29.107647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a8dc9878-d997-4ca9-bde3-4daf78f49925 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:29.108134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a8dc9878-d997-4ca9-bde3-4daf78f49925 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:29.219344 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a8dc9878-d997-4ca9-bde3-4daf78f49925 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 27856 microversion: 2.1 time: 0.129025 Apr 16 16:56:29.220068 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 455/897] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:29 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 27856 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:29.616398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-20799cc0-89d5-4429-88df-2f174b5f0827 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:29.617629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-20799cc0-89d5-4429-88df-2f174b5f0827 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:29.630228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20799cc0-89d5-4429-88df-2f174b5f0827 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:29.630763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20799cc0-89d5-4429-88df-2f174b5f0827 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:29.631649 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20799cc0-89d5-4429-88df-2f174b5f0827 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:29.632191 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20799cc0-89d5-4429-88df-2f174b5f0827 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:29.849424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-49da9ba3-3466-4ff1-8aa2-4ac50061e195 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:29.850417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-49da9ba3-3466-4ff1-8aa2-4ac50061e195 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:29.869184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-49da9ba3-3466-4ff1-8aa2-4ac50061e195 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:29.870136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-49da9ba3-3466-4ff1-8aa2-4ac50061e195 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:29.872410 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-49da9ba3-3466-4ff1-8aa2-4ac50061e195 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:29.873324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-49da9ba3-3466-4ff1-8aa2-4ac50061e195 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:30.191050 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-20799cc0-89d5-4429-88df-2f174b5f0827 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:30.201306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-20799cc0-89d5-4429-88df-2f174b5f0827 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:30.203741 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-20799cc0-89d5-4429-88df-2f174b5f0827 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:30.205078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-20799cc0-89d5-4429-88df-2f174b5f0827 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.592911 Apr 16 16:56:30.205723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 443/898] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:29 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:30.237175 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e3021eae-1dca-4e37-90f8-51b8ff747422 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:30.238391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e3021eae-1dca-4e37-90f8-51b8ff747422 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:30.251424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3021eae-1dca-4e37-90f8-51b8ff747422 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:30.252352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3021eae-1dca-4e37-90f8-51b8ff747422 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:30.254035 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3021eae-1dca-4e37-90f8-51b8ff747422 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:30.254917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e3021eae-1dca-4e37-90f8-51b8ff747422 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:30.404873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e3021eae-1dca-4e37-90f8-51b8ff747422 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28164 microversion: 2.1 time: 0.173707 Apr 16 16:56:30.406997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 444/899] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:30 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28164 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:30.482093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-49da9ba3-3466-4ff1-8aa2-4ac50061e195 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:30.492916 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-49da9ba3-3466-4ff1-8aa2-4ac50061e195 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1280 microversion: 2.1 time: 0.653761 Apr 16 16:56:30.493571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 456/900] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:29 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1280 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:31.228075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f893db2b-d99a-4b5f-9da1-89c6ae8eb293 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:31.230251 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f893db2b-d99a-4b5f-9da1-89c6ae8eb293 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:31.242372 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f893db2b-d99a-4b5f-9da1-89c6ae8eb293 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:31.243046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f893db2b-d99a-4b5f-9da1-89c6ae8eb293 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:31.243917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f893db2b-d99a-4b5f-9da1-89c6ae8eb293 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:31.244413 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f893db2b-d99a-4b5f-9da1-89c6ae8eb293 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:31.433663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-280edf1c-3600-44cc-b1e4-8139fde86651 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:31.435541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-280edf1c-3600-44cc-b1e4-8139fde86651 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:31.458454 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-280edf1c-3600-44cc-b1e4-8139fde86651 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:31.459082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-280edf1c-3600-44cc-b1e4-8139fde86651 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:31.459972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-280edf1c-3600-44cc-b1e4-8139fde86651 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:31.460472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-280edf1c-3600-44cc-b1e4-8139fde86651 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:31.612617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-280edf1c-3600-44cc-b1e4-8139fde86651 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28166 microversion: 2.1 time: 0.191911 Apr 16 16:56:31.613768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 457/901] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:31 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28166 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:31.619488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7aa63222-1e14-4440-b914-1d21a3c1e565 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:31.620490 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7aa63222-1e14-4440-b914-1d21a3c1e565 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:31.631851 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7aa63222-1e14-4440-b914-1d21a3c1e565 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:31.632637 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7aa63222-1e14-4440-b914-1d21a3c1e565 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:31.633904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7aa63222-1e14-4440-b914-1d21a3c1e565 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:31.634629 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7aa63222-1e14-4440-b914-1d21a3c1e565 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:31.728826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f893db2b-d99a-4b5f-9da1-89c6ae8eb293 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:31.750697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f893db2b-d99a-4b5f-9da1-89c6ae8eb293 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:31.754689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f893db2b-d99a-4b5f-9da1-89c6ae8eb293 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:31.757168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f893db2b-d99a-4b5f-9da1-89c6ae8eb293 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1749 microversion: 2.20 time: 0.534663 Apr 16 16:56:31.758618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 445/902] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:31 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1749 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:32.216967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7aa63222-1e14-4440-b914-1d21a3c1e565 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:32.236817 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7aa63222-1e14-4440-b914-1d21a3c1e565 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.621042 Apr 16 16:56:32.238111 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 458/903] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:31 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:32.307784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-e81fce4a-8b29-4a9b-be9c-1ec81c13e484 req-cf998fd4-f317-417c-ae77-56521811ea65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ed33ad-b824-4144-a51d-81ba74e24a4b", "tag": "2139fff4-2645-4ee4-90d3-2b1dcf4f8a76"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:32.309813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:56:32.309813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:56:32.321198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-e81fce4a-8b29-4a9b-be9c-1ec81c13e484 req-cf998fd4-f317-417c-ae77-56521811ea65 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:32.321910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-e81fce4a-8b29-4a9b-be9c-1ec81c13e484 req-cf998fd4-f317-417c-ae77-56521811ea65 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:32.345721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-e81fce4a-8b29-4a9b-be9c-1ec81c13e484 req-cf998fd4-f317-417c-ae77-56521811ea65 service nova] Creating event network-changed:2139fff4-2645-4ee4-90d3-2b1dcf4f8a76 for instance a3ed33ad-b824-4144-a51d-81ba74e24a4b on hv-cinder-73362 Apr 16 16:56:32.355666 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-e81fce4a-8b29-4a9b-be9c-1ec81c13e484 req-cf998fd4-f317-417c-ae77-56521811ea65 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051140 Apr 16 16:56:32.356901 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 446/904] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:56:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:56:32.628516 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f04495d0-5f79-4b0b-8ca4-a26bf0a261ab tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:32.629752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f04495d0-5f79-4b0b-8ca4-a26bf0a261ab tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:32.638660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f04495d0-5f79-4b0b-8ca4-a26bf0a261ab tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:32.639178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f04495d0-5f79-4b0b-8ca4-a26bf0a261ab tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:32.640567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f04495d0-5f79-4b0b-8ca4-a26bf0a261ab tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:32.641061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f04495d0-5f79-4b0b-8ca4-a26bf0a261ab tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:32.757703 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f04495d0-5f79-4b0b-8ca4-a26bf0a261ab tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28166 microversion: 2.1 time: 0.133651 Apr 16 16:56:32.758655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 459/905] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:32 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28166 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:56:32.782038 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e7952978-54fb-4445-b421-cadde6fab64f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:32.782887 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e7952978-54fb-4445-b421-cadde6fab64f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:32.791297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e7952978-54fb-4445-b421-cadde6fab64f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:32.791806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e7952978-54fb-4445-b421-cadde6fab64f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:32.792720 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e7952978-54fb-4445-b421-cadde6fab64f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:32.793190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e7952978-54fb-4445-b421-cadde6fab64f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:33.161300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e7952978-54fb-4445-b421-cadde6fab64f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:33.173333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e7952978-54fb-4445-b421-cadde6fab64f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:33.175376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e7952978-54fb-4445-b421-cadde6fab64f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:33.176729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e7952978-54fb-4445-b421-cadde6fab64f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1749 microversion: 2.20 time: 0.400164 Apr 16 16:56:33.177334 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 447/906] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:32 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1749 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:33.264409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-38eec3ee-ad64-418a-9d85-cb984fe18ac1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:33.267269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-38eec3ee-ad64-418a-9d85-cb984fe18ac1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:33.276819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-38eec3ee-ad64-418a-9d85-cb984fe18ac1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:33.277665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-38eec3ee-ad64-418a-9d85-cb984fe18ac1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:33.278755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-38eec3ee-ad64-418a-9d85-cb984fe18ac1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:33.279441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-38eec3ee-ad64-418a-9d85-cb984fe18ac1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:33.416807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-83685a75-34eb-4c11-b77d-78659e790ec0 req-7306018d-3716-4115-8277-c207de27fe13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a606efe-c285-436f-9d27-d09708bc4564", "name": "network-vif-plugged", "status": "completed", "tag": "aef9925c-8048-4095-a618-0d55f10b32a1"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:33.419373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:56:33.419373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:56:33.431398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-83685a75-34eb-4c11-b77d-78659e790ec0 req-7306018d-3716-4115-8277-c207de27fe13 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:33.432191 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-83685a75-34eb-4c11-b77d-78659e790ec0 req-7306018d-3716-4115-8277-c207de27fe13 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:33.453918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-83685a75-34eb-4c11-b77d-78659e790ec0 req-7306018d-3716-4115-8277-c207de27fe13 service nova] Creating event network-vif-plugged:aef9925c-8048-4095-a618-0d55f10b32a1 for instance 4a606efe-c285-436f-9d27-d09708bc4564 on hv-cinder-73362 Apr 16 16:56:33.460218 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-83685a75-34eb-4c11-b77d-78659e790ec0 req-7306018d-3716-4115-8277-c207de27fe13 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047453 Apr 16 16:56:33.461048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 448/907] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:56:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:56:33.603107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-38eec3ee-ad64-418a-9d85-cb984fe18ac1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:33.614902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-38eec3ee-ad64-418a-9d85-cb984fe18ac1 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.355604 Apr 16 16:56:33.616131 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 460/908] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:33 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:33.771147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-14242cdf-c6a7-4a39-92b1-a8348342c742 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:33.773143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-14242cdf-c6a7-4a39-92b1-a8348342c742 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:33.782964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14242cdf-c6a7-4a39-92b1-a8348342c742 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:33.785571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14242cdf-c6a7-4a39-92b1-a8348342c742 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:33.786685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14242cdf-c6a7-4a39-92b1-a8348342c742 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:33.787408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-14242cdf-c6a7-4a39-92b1-a8348342c742 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:33.903406 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-14242cdf-c6a7-4a39-92b1-a8348342c742 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28166 microversion: 2.1 time: 0.136788 Apr 16 16:56:33.904570 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 449/909] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:33 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28166 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:34.197723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-63e13c72-a961-45df-954c-22dfc80037e0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:34.198518 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-63e13c72-a961-45df-954c-22dfc80037e0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:34.210674 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63e13c72-a961-45df-954c-22dfc80037e0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:34.211386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63e13c72-a961-45df-954c-22dfc80037e0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:34.212550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63e13c72-a961-45df-954c-22dfc80037e0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:34.213857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-63e13c72-a961-45df-954c-22dfc80037e0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:34.612981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-63e13c72-a961-45df-954c-22dfc80037e0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:34.623692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-63e13c72-a961-45df-954c-22dfc80037e0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:34.625584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-63e13c72-a961-45df-954c-22dfc80037e0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:34.627884 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-63e13c72-a961-45df-954c-22dfc80037e0 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1744 microversion: 2.20 time: 0.433355 Apr 16 16:56:34.628140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 461/910] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:34 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1744 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:34.647562 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7e8da890-9b8e-4802-8488-4ee15088111d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:34.648895 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7e8da890-9b8e-4802-8488-4ee15088111d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:34.660859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e8da890-9b8e-4802-8488-4ee15088111d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:34.661830 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e8da890-9b8e-4802-8488-4ee15088111d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:34.663293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e8da890-9b8e-4802-8488-4ee15088111d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:34.664039 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e8da890-9b8e-4802-8488-4ee15088111d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:34.917897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0d4e04e1-3e29-4c4b-883a-a0811d851aff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:34.919557 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0d4e04e1-3e29-4c4b-883a-a0811d851aff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:34.929620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d4e04e1-3e29-4c4b-883a-a0811d851aff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:34.930451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d4e04e1-3e29-4c4b-883a-a0811d851aff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:34.931568 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d4e04e1-3e29-4c4b-883a-a0811d851aff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:34.932222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0d4e04e1-3e29-4c4b-883a-a0811d851aff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:34.967973 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7e8da890-9b8e-4802-8488-4ee15088111d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:34.978890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7e8da890-9b8e-4802-8488-4ee15088111d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.337768 Apr 16 16:56:34.979951 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 450/911] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:34 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:35.080016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0d4e04e1-3e29-4c4b-883a-a0811d851aff tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28408 microversion: 2.1 time: 0.166688 Apr 16 16:56:35.080877 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 462/912] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:34 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:56:35.651937 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-52f3d9a9-f82d-4ba1-8be5-72a9be5198b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:35.652812 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-52f3d9a9-f82d-4ba1-8be5-72a9be5198b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:35.677323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52f3d9a9-f82d-4ba1-8be5-72a9be5198b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:35.677814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52f3d9a9-f82d-4ba1-8be5-72a9be5198b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:35.685537 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52f3d9a9-f82d-4ba1-8be5-72a9be5198b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:35.686192 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-52f3d9a9-f82d-4ba1-8be5-72a9be5198b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:35.960564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-52f3d9a9-f82d-4ba1-8be5-72a9be5198b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:35.972838 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-52f3d9a9-f82d-4ba1-8be5-72a9be5198b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:35.973086 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-52f3d9a9-f82d-4ba1-8be5-72a9be5198b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:35.974319 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-52f3d9a9-f82d-4ba1-8be5-72a9be5198b5 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1744 microversion: 2.20 time: 0.327410 Apr 16 16:56:35.975295 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 451/913] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:35 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1744 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:36.001660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-47e936ea-ab0b-4630-9762-297cab408b57 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:36.002414 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-47e936ea-ab0b-4630-9762-297cab408b57 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:36.011972 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-47e936ea-ab0b-4630-9762-297cab408b57 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:36.012481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-47e936ea-ab0b-4630-9762-297cab408b57 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:36.013344 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-47e936ea-ab0b-4630-9762-297cab408b57 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:36.013841 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-47e936ea-ab0b-4630-9762-297cab408b57 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:36.104949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e1010c32-097b-460d-b753-d7ce99d1132e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:36.106090 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e1010c32-097b-460d-b753-d7ce99d1132e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:36.126864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1010c32-097b-460d-b753-d7ce99d1132e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:36.127379 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1010c32-097b-460d-b753-d7ce99d1132e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:36.128247 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1010c32-097b-460d-b753-d7ce99d1132e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:36.128745 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e1010c32-097b-460d-b753-d7ce99d1132e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:36.244120 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e1010c32-097b-460d-b753-d7ce99d1132e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28457 microversion: 2.1 time: 0.152855 Apr 16 16:56:36.245589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 452/914] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:36 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28457 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:36.257705 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-47e936ea-ab0b-4630-9762-297cab408b57 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:36.268243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-47e936ea-ab0b-4630-9762-297cab408b57 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.272050 Apr 16 16:56:36.268879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 463/915] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:35 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:37.020181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e783010b-d533-4eea-9c36-be35adf04fb3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:37.022837 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e783010b-d533-4eea-9c36-be35adf04fb3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:37.044540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e783010b-d533-4eea-9c36-be35adf04fb3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:37.045362 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e783010b-d533-4eea-9c36-be35adf04fb3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:37.050620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e783010b-d533-4eea-9c36-be35adf04fb3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:37.051476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e783010b-d533-4eea-9c36-be35adf04fb3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:37.262321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a778ea4e-f326-468b-9173-520c23ff53a9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:37.264268 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a778ea4e-f326-468b-9173-520c23ff53a9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:37.277167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a778ea4e-f326-468b-9173-520c23ff53a9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:37.277167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a778ea4e-f326-468b-9173-520c23ff53a9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:37.279348 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a778ea4e-f326-468b-9173-520c23ff53a9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:37.279348 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a778ea4e-f326-468b-9173-520c23ff53a9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:37.352013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e783010b-d533-4eea-9c36-be35adf04fb3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:37.369225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e783010b-d533-4eea-9c36-be35adf04fb3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:37.371735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e783010b-d533-4eea-9c36-be35adf04fb3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:37.377221 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e783010b-d533-4eea-9c36-be35adf04fb3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1744 microversion: 2.20 time: 0.381190 Apr 16 16:56:37.389280 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 453/916] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:36 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1744 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:37.389280 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b19b15a3-91d4-4a54-aabf-95e93e51533e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:37.389280 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b19b15a3-91d4-4a54-aabf-95e93e51533e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:37.398528 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b19b15a3-91d4-4a54-aabf-95e93e51533e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:37.399199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b19b15a3-91d4-4a54-aabf-95e93e51533e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:37.400249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b19b15a3-91d4-4a54-aabf-95e93e51533e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:37.401387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b19b15a3-91d4-4a54-aabf-95e93e51533e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:37.433560 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a778ea4e-f326-468b-9173-520c23ff53a9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28615 microversion: 2.1 time: 0.179155 Apr 16 16:56:37.435271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 464/917] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:37 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28615 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:37.719409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b19b15a3-91d4-4a54-aabf-95e93e51533e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:37.730481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b19b15a3-91d4-4a54-aabf-95e93e51533e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.349720 Apr 16 16:56:37.741920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 454/918] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:37 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:38.398066 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-268772e2-e203-4c13-8547-a62e556305d4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:38.399689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-268772e2-e203-4c13-8547-a62e556305d4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:38.409763 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-268772e2-e203-4c13-8547-a62e556305d4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:38.410399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-268772e2-e203-4c13-8547-a62e556305d4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:38.411480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-268772e2-e203-4c13-8547-a62e556305d4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:38.412198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-268772e2-e203-4c13-8547-a62e556305d4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:38.452905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8513757c-6407-4fc3-b47b-cfad80739f69 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:38.454234 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8513757c-6407-4fc3-b47b-cfad80739f69 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:38.470399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8513757c-6407-4fc3-b47b-cfad80739f69 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:38.471971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8513757c-6407-4fc3-b47b-cfad80739f69 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:38.472909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8513757c-6407-4fc3-b47b-cfad80739f69 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:38.474618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8513757c-6407-4fc3-b47b-cfad80739f69 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:38.612898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8513757c-6407-4fc3-b47b-cfad80739f69 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28615 microversion: 2.1 time: 0.164852 Apr 16 16:56:38.618182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 455/919] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:38 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28615 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:38.736168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-268772e2-e203-4c13-8547-a62e556305d4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:38.750323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-268772e2-e203-4c13-8547-a62e556305d4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:38.752828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-268772e2-e203-4c13-8547-a62e556305d4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:38.754679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-268772e2-e203-4c13-8547-a62e556305d4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1744 microversion: 2.20 time: 0.361378 Apr 16 16:56:38.758416 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bbac2b23-5676-4381-a93f-82e975b7d829 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:38.759636 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bbac2b23-5676-4381-a93f-82e975b7d829 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:38.767337 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 465/920] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:38 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1744 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:38.775716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bbac2b23-5676-4381-a93f-82e975b7d829 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:38.776272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bbac2b23-5676-4381-a93f-82e975b7d829 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:38.777415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bbac2b23-5676-4381-a93f-82e975b7d829 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:38.777966 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bbac2b23-5676-4381-a93f-82e975b7d829 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:39.023920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-bbac2b23-5676-4381-a93f-82e975b7d829 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:39.058450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bbac2b23-5676-4381-a93f-82e975b7d829 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.310246 Apr 16 16:56:39.059344 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 456/921] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:38 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:56:39.627634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1b22134e-524f-40c5-8057-086d707d8d5c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:39.629729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1b22134e-524f-40c5-8057-086d707d8d5c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:39.638070 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b22134e-524f-40c5-8057-086d707d8d5c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:39.638920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b22134e-524f-40c5-8057-086d707d8d5c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:39.640145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b22134e-524f-40c5-8057-086d707d8d5c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:39.640714 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1b22134e-524f-40c5-8057-086d707d8d5c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:39.753904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1b22134e-524f-40c5-8057-086d707d8d5c tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28615 microversion: 2.1 time: 0.132025 Apr 16 16:56:39.755069 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 466/922] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:39 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28615 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:39.776917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-85fc9504-864b-4326-bd99-6edf627f41fe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:39.778219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-85fc9504-864b-4326-bd99-6edf627f41fe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:39.789833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85fc9504-864b-4326-bd99-6edf627f41fe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:39.790823 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85fc9504-864b-4326-bd99-6edf627f41fe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:39.792186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85fc9504-864b-4326-bd99-6edf627f41fe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:39.793059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-85fc9504-864b-4326-bd99-6edf627f41fe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:40.038858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-85fc9504-864b-4326-bd99-6edf627f41fe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:40.050827 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-85fc9504-864b-4326-bd99-6edf627f41fe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:40.052675 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-85fc9504-864b-4326-bd99-6edf627f41fe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:40.054600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-85fc9504-864b-4326-bd99-6edf627f41fe tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1744 microversion: 2.20 time: 0.282624 Apr 16 16:56:40.055465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 457/923] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:39 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1744 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:40.078460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9efa0aa1-4bf3-46c6-a047-b90171582e29 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:40.079678 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9efa0aa1-4bf3-46c6-a047-b90171582e29 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:40.091257 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9efa0aa1-4bf3-46c6-a047-b90171582e29 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:40.094977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9efa0aa1-4bf3-46c6-a047-b90171582e29 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:40.096107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9efa0aa1-4bf3-46c6-a047-b90171582e29 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:40.096989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9efa0aa1-4bf3-46c6-a047-b90171582e29 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:40.424821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9efa0aa1-4bf3-46c6-a047-b90171582e29 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:40.436929 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9efa0aa1-4bf3-46c6-a047-b90171582e29 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.363718 Apr 16 16:56:40.437166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 467/924] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:40 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:40.766782 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e4455246-4be5-4a7a-9d54-a4edb5e5eb61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:40.768240 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e4455246-4be5-4a7a-9d54-a4edb5e5eb61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:40.781797 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e4455246-4be5-4a7a-9d54-a4edb5e5eb61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:40.782316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e4455246-4be5-4a7a-9d54-a4edb5e5eb61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:40.783166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e4455246-4be5-4a7a-9d54-a4edb5e5eb61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:40.783827 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e4455246-4be5-4a7a-9d54-a4edb5e5eb61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:40.911335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e4455246-4be5-4a7a-9d54-a4edb5e5eb61 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28615 microversion: 2.1 time: 0.148578 Apr 16 16:56:40.912854 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 458/925] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:40 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28615 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:41.075732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e670f9a7-cf19-4e96-b285-520d28b690a4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:41.077330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e670f9a7-cf19-4e96-b285-520d28b690a4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:41.085806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e670f9a7-cf19-4e96-b285-520d28b690a4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:41.086387 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e670f9a7-cf19-4e96-b285-520d28b690a4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:41.087502 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e670f9a7-cf19-4e96-b285-520d28b690a4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:41.088212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e670f9a7-cf19-4e96-b285-520d28b690a4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:41.379901 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e670f9a7-cf19-4e96-b285-520d28b690a4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:41.409071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e670f9a7-cf19-4e96-b285-520d28b690a4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:41.411318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e670f9a7-cf19-4e96-b285-520d28b690a4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:41.412752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e670f9a7-cf19-4e96-b285-520d28b690a4 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1744 microversion: 2.20 time: 0.341687 Apr 16 16:56:41.413705 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 468/926] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:41 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1744 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:56:41.458861 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fb856151-b93d-471c-8eb5-00fe2fb4ce43 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:41.460507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fb856151-b93d-471c-8eb5-00fe2fb4ce43 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:41.471495 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb856151-b93d-471c-8eb5-00fe2fb4ce43 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:41.471998 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb856151-b93d-471c-8eb5-00fe2fb4ce43 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:41.472859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb856151-b93d-471c-8eb5-00fe2fb4ce43 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:41.473576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb856151-b93d-471c-8eb5-00fe2fb4ce43 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:41.739280 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fb856151-b93d-471c-8eb5-00fe2fb4ce43 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:41.750271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fb856151-b93d-471c-8eb5-00fe2fb4ce43 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.298633 Apr 16 16:56:41.751186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 459/927] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:41 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:41.927897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1e45da29-c911-4939-9e63-c6feb7bd730f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:41.928954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1e45da29-c911-4939-9e63-c6feb7bd730f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:41.942465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e45da29-c911-4939-9e63-c6feb7bd730f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:41.943118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e45da29-c911-4939-9e63-c6feb7bd730f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:41.944078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e45da29-c911-4939-9e63-c6feb7bd730f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:41.944651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1e45da29-c911-4939-9e63-c6feb7bd730f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:42.098995 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1e45da29-c911-4939-9e63-c6feb7bd730f tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 28615 microversion: 2.1 time: 0.176129 Apr 16 16:56:42.103289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 469/928] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:41 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 28615 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:42.433476 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3a1623a1-5c7b-44ed-b120-b16657872090 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:42.434484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3a1623a1-5c7b-44ed-b120-b16657872090 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:42.446863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a1623a1-5c7b-44ed-b120-b16657872090 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:42.447372 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a1623a1-5c7b-44ed-b120-b16657872090 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:42.448351 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a1623a1-5c7b-44ed-b120-b16657872090 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:42.450150 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a1623a1-5c7b-44ed-b120-b16657872090 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:42.767878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3a1623a1-5c7b-44ed-b120-b16657872090 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:42.770915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fb3924bd-752f-4dbb-80c1-dd7d961df654 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:42.771793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fb3924bd-752f-4dbb-80c1-dd7d961df654 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:42.788391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3a1623a1-5c7b-44ed-b120-b16657872090 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:42.788764 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb3924bd-752f-4dbb-80c1-dd7d961df654 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:42.788952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb3924bd-752f-4dbb-80c1-dd7d961df654 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:42.789812 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb3924bd-752f-4dbb-80c1-dd7d961df654 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:42.790323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fb3924bd-752f-4dbb-80c1-dd7d961df654 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:42.793003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3a1623a1-5c7b-44ed-b120-b16657872090 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:42.797238 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3a1623a1-5c7b-44ed-b120-b16657872090 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1744 microversion: 2.20 time: 0.366092 Apr 16 16:56:42.798671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 460/929] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:42 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1744 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:43.073651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fb3924bd-752f-4dbb-80c1-dd7d961df654 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:43.086465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fb3924bd-752f-4dbb-80c1-dd7d961df654 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.320263 Apr 16 16:56:43.087255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 470/930] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:42 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:43.117228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-04251922-0988-4275-85df-021e9cbabd21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:43.119254 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-04251922-0988-4275-85df-021e9cbabd21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:43.135075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-04251922-0988-4275-85df-021e9cbabd21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:43.135893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-04251922-0988-4275-85df-021e9cbabd21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:43.137346 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-04251922-0988-4275-85df-021e9cbabd21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:43.138179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-04251922-0988-4275-85df-021e9cbabd21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:43.443269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-04251922-0988-4275-85df-021e9cbabd21 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 29404 microversion: 2.1 time: 0.332692 Apr 16 16:56:43.443720 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 461/931] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:43 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 29404 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:43.832031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-681ad100-4af2-43aa-82ac-f991f7c9d9ae tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:43.832827 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-681ad100-4af2-43aa-82ac-f991f7c9d9ae tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:43.842703 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681ad100-4af2-43aa-82ac-f991f7c9d9ae tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:43.843318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681ad100-4af2-43aa-82ac-f991f7c9d9ae tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:43.844329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681ad100-4af2-43aa-82ac-f991f7c9d9ae tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:43.844924 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-681ad100-4af2-43aa-82ac-f991f7c9d9ae tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:44.127861 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5273df75-986c-477f-97ec-b625de7a373c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:44.127861 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5273df75-986c-477f-97ec-b625de7a373c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:44.130774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-681ad100-4af2-43aa-82ac-f991f7c9d9ae tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:44.130920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5273df75-986c-477f-97ec-b625de7a373c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:44.130920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5273df75-986c-477f-97ec-b625de7a373c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:44.130920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5273df75-986c-477f-97ec-b625de7a373c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:44.130920 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5273df75-986c-477f-97ec-b625de7a373c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:44.141745 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-681ad100-4af2-43aa-82ac-f991f7c9d9ae tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:44.144098 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-681ad100-4af2-43aa-82ac-f991f7c9d9ae tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:44.146149 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-681ad100-4af2-43aa-82ac-f991f7c9d9ae tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1744 microversion: 2.20 time: 0.318960 Apr 16 16:56:44.150345 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 471/932] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:43 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1744 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:44.426898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5273df75-986c-477f-97ec-b625de7a373c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:44.437949 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5273df75-986c-477f-97ec-b625de7a373c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.332784 Apr 16 16:56:44.438651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 462/933] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:44 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:44.456148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4b033000-e08a-4353-9aa1-7ceb769db132 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:44.457461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4b033000-e08a-4353-9aa1-7ceb769db132 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:44.466086 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4b033000-e08a-4353-9aa1-7ceb769db132 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:44.466708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4b033000-e08a-4353-9aa1-7ceb769db132 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:44.467848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4b033000-e08a-4353-9aa1-7ceb769db132 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:44.468363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4b033000-e08a-4353-9aa1-7ceb769db132 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:44.587303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4b033000-e08a-4353-9aa1-7ceb769db132 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 30932 microversion: 2.1 time: 0.135562 Apr 16 16:56:44.590354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 472/934] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:44 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 30932 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:45.136948 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4f420eb4-08c7-4c62-ad1c-a54442cc2da2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2102634327"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:45.137676 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4f420eb4-08c7-4c62-ad1c-a54442cc2da2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:45.147616 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f420eb4-08c7-4c62-ad1c-a54442cc2da2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:45.148448 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f420eb4-08c7-4c62-ad1c-a54442cc2da2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:45.149486 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f420eb4-08c7-4c62-ad1c-a54442cc2da2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:45.149970 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4f420eb4-08c7-4c62-ad1c-a54442cc2da2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:45.177812 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fd331f67-b450-49ae-a781-d460f54e41e8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:45.179994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fd331f67-b450-49ae-a781-d460f54e41e8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:45.204077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd331f67-b450-49ae-a781-d460f54e41e8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:45.205410 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd331f67-b450-49ae-a781-d460f54e41e8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:45.207289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd331f67-b450-49ae-a781-d460f54e41e8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:45.209156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fd331f67-b450-49ae-a781-d460f54e41e8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:46.042875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.network.security_group_api [None req-4f420eb4-08c7-4c62-ad1c-a54442cc2da2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Removing security group dbdcd3e8-dd73-4ca1-915f-d3cd574a0d1b from port 48feea5a-19f4-4f16-80f8-5166404c8b45 Apr 16 16:56:46.255812 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fd331f67-b450-49ae-a781-d460f54e41e8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:46.272518 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fd331f67-b450-49ae-a781-d460f54e41e8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:46.275198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fd331f67-b450-49ae-a781-d460f54e41e8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:46.277399 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fd331f67-b450-49ae-a781-d460f54e41e8 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1726 microversion: 2.20 time: 1.111163 Apr 16 16:56:46.278295 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 473/935] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:45 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1726 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:46.284723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2d536c89-da66-46ed-8d2d-776ceb186739 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:46.285904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2d536c89-da66-46ed-8d2d-776ceb186739 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:46.296954 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d536c89-da66-46ed-8d2d-776ceb186739 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:46.298152 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d536c89-da66-46ed-8d2d-776ceb186739 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:46.299396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d536c89-da66-46ed-8d2d-776ceb186739 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:46.300115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2d536c89-da66-46ed-8d2d-776ceb186739 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:47.180615 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2d536c89-da66-46ed-8d2d-776ceb186739 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:47.189948 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2d536c89-da66-46ed-8d2d-776ceb186739 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.910251 Apr 16 16:56:47.190634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 474/936] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:46 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:47.195475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-37d0f1dd-7323-4d5b-af33-d31c41b33fbc req-1d41bd3f-4f76-4cff-963b-2548da05f3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ed33ad-b824-4144-a51d-81ba74e24a4b", "name": "network-vif-plugged", "status": "completed", "tag": "2139fff4-2645-4ee4-90d3-2b1dcf4f8a76"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:47.197249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:56:47.197249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:56:47.208770 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-37d0f1dd-7323-4d5b-af33-d31c41b33fbc req-1d41bd3f-4f76-4cff-963b-2548da05f3e3 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:47.209380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-37d0f1dd-7323-4d5b-af33-d31c41b33fbc req-1d41bd3f-4f76-4cff-963b-2548da05f3e3 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:47.232547 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-37d0f1dd-7323-4d5b-af33-d31c41b33fbc req-1d41bd3f-4f76-4cff-963b-2548da05f3e3 service nova] Creating event network-vif-plugged:2139fff4-2645-4ee4-90d3-2b1dcf4f8a76 for instance a3ed33ad-b824-4144-a51d-81ba74e24a4b on hv-cinder-73362 Apr 16 16:56:47.238701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-37d0f1dd-7323-4d5b-af33-d31c41b33fbc req-1d41bd3f-4f76-4cff-963b-2548da05f3e3 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046522 Apr 16 16:56:47.239349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 475/937] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:56:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:56:47.245844 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7ce8dd6d-263d-423e-a788-d13edd6363c2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:47.247373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7ce8dd6d-263d-423e-a788-d13edd6363c2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:47.256809 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7ce8dd6d-263d-423e-a788-d13edd6363c2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:47.257473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7ce8dd6d-263d-423e-a788-d13edd6363c2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:47.258410 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7ce8dd6d-263d-423e-a788-d13edd6363c2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:47.258911 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7ce8dd6d-263d-423e-a788-d13edd6363c2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:47.383524 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7ce8dd6d-263d-423e-a788-d13edd6363c2 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 33667 microversion: 2.1 time: 0.142221 Apr 16 16:56:47.388605 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 476/938] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:47 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 33667 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:47.395946 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e811bcff-f8fd-45b4-8dae-ff0aaaf0416d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:47.397236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e811bcff-f8fd-45b4-8dae-ff0aaaf0416d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:47.406888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e811bcff-f8fd-45b4-8dae-ff0aaaf0416d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:47.407787 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e811bcff-f8fd-45b4-8dae-ff0aaaf0416d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:47.408873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e811bcff-f8fd-45b4-8dae-ff0aaaf0416d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:47.409828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e811bcff-f8fd-45b4-8dae-ff0aaaf0416d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:47.496054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4f420eb4-08c7-4c62-ad1c-a54442cc2da2 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "POST /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/action" status: 202 len: 0 microversion: 2.1 time: 2.363214 Apr 16 16:56:47.497059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 463/939] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:45 2021] POST /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/action => generated 0 bytes in 2365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:56:47.524249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-68130320-a7bd-4e04-bb3e-f350e126cb18 req-b5bcdb6a-dec8-4c40-ae26-2e5402a426cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f254d3-c0d6-4c32-897b-e19f47934010", "tag": "48feea5a-19f4-4f16-80f8-5166404c8b45"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:47.527415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:56:47.527415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:56:47.537481 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-68130320-a7bd-4e04-bb3e-f350e126cb18 req-b5bcdb6a-dec8-4c40-ae26-2e5402a426cc service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:47.537990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-68130320-a7bd-4e04-bb3e-f350e126cb18 req-b5bcdb6a-dec8-4c40-ae26-2e5402a426cc service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:47.559780 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-68130320-a7bd-4e04-bb3e-f350e126cb18 req-b5bcdb6a-dec8-4c40-ae26-2e5402a426cc service nova] Creating event network-changed:48feea5a-19f4-4f16-80f8-5166404c8b45 for instance a0f254d3-c0d6-4c32-897b-e19f47934010 on hv-cinder-73362 Apr 16 16:56:47.568290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-68130320-a7bd-4e04-bb3e-f350e126cb18 req-b5bcdb6a-dec8-4c40-ae26-2e5402a426cc service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049381 Apr 16 16:56:47.569428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 464/940] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:56:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:56:47.830952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e811bcff-f8fd-45b4-8dae-ff0aaaf0416d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:47.841280 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e811bcff-f8fd-45b4-8dae-ff0aaaf0416d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:47.843547 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e811bcff-f8fd-45b4-8dae-ff0aaaf0416d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:47.844918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e811bcff-f8fd-45b4-8dae-ff0aaaf0416d tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1726 microversion: 2.20 time: 0.453803 Apr 16 16:56:47.845619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 477/941] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:47 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1726 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:48.212278 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e2721da0-68d0-4658-911b-faf58c68532e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:48.213179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e2721da0-68d0-4658-911b-faf58c68532e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:48.222010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2721da0-68d0-4658-911b-faf58c68532e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:48.222650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2721da0-68d0-4658-911b-faf58c68532e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:48.223580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2721da0-68d0-4658-911b-faf58c68532e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:48.224230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2721da0-68d0-4658-911b-faf58c68532e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:48.403290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8e470198-5d34-4374-b05e-7ef029101c7b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:48.407141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8e470198-5d34-4374-b05e-7ef029101c7b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:48.423732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e470198-5d34-4374-b05e-7ef029101c7b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:48.424489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e470198-5d34-4374-b05e-7ef029101c7b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:48.425498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e470198-5d34-4374-b05e-7ef029101c7b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:48.426226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8e470198-5d34-4374-b05e-7ef029101c7b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:48.483684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e2721da0-68d0-4658-911b-faf58c68532e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:48.495030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e2721da0-68d0-4658-911b-faf58c68532e tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.288295 Apr 16 16:56:48.495668 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 465/942] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:48 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:48.548026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8e470198-5d34-4374-b05e-7ef029101c7b tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 34193 microversion: 2.1 time: 0.154435 Apr 16 16:56:48.548981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 478/943] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:48 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 34193 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:48.866336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a74b4c85-a7d7-49c0-a9ca-595bdc9d36a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:48.867719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a74b4c85-a7d7-49c0-a9ca-595bdc9d36a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:48.882951 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a74b4c85-a7d7-49c0-a9ca-595bdc9d36a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:48.883875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a74b4c85-a7d7-49c0-a9ca-595bdc9d36a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:48.885400 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a74b4c85-a7d7-49c0-a9ca-595bdc9d36a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:48.886328 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a74b4c85-a7d7-49c0-a9ca-595bdc9d36a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:49.127611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a74b4c85-a7d7-49c0-a9ca-595bdc9d36a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:49.137264 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a74b4c85-a7d7-49c0-a9ca-595bdc9d36a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:49.139151 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a74b4c85-a7d7-49c0-a9ca-595bdc9d36a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:49.140586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a74b4c85-a7d7-49c0-a9ca-595bdc9d36a9 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1726 microversion: 2.20 time: 0.279342 Apr 16 16:56:49.141437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 466/944] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:48 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1726 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:49.254766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-eb26c103-a4d3-4cc6-b0a4-a056ff7c5bcb req-2cac888b-8c71-488d-9577-45c675cd73fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a606efe-c285-436f-9d27-d09708bc4564", "name": "network-vif-unplugged", "status": "completed", "tag": "aef9925c-8048-4095-a618-0d55f10b32a1"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:49.256465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:56:49.256465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:56:49.267271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-eb26c103-a4d3-4cc6-b0a4-a056ff7c5bcb req-2cac888b-8c71-488d-9577-45c675cd73fa service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:49.267783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-eb26c103-a4d3-4cc6-b0a4-a056ff7c5bcb req-2cac888b-8c71-488d-9577-45c675cd73fa service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:49.287157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-eb26c103-a4d3-4cc6-b0a4-a056ff7c5bcb req-2cac888b-8c71-488d-9577-45c675cd73fa service nova] Creating event network-vif-unplugged:aef9925c-8048-4095-a618-0d55f10b32a1 for instance 4a606efe-c285-436f-9d27-d09708bc4564 on hv-cinder-73362 Apr 16 16:56:49.293207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-eb26c103-a4d3-4cc6-b0a4-a056ff7c5bcb req-2cac888b-8c71-488d-9577-45c675cd73fa service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042803 Apr 16 16:56:49.293875 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 479/945] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:56:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:56:49.516564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-45c7415d-e606-42b7-8ed4-7331b3a4f963 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:49.517135 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-45c7415d-e606-42b7-8ed4-7331b3a4f963 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:49.525809 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45c7415d-e606-42b7-8ed4-7331b3a4f963 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:49.526390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45c7415d-e606-42b7-8ed4-7331b3a4f963 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:49.527598 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45c7415d-e606-42b7-8ed4-7331b3a4f963 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:49.527850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45c7415d-e606-42b7-8ed4-7331b3a4f963 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:49.562609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c6239afd-204b-410b-90f5-b9f8f8a78701 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:49.563950 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c6239afd-204b-410b-90f5-b9f8f8a78701 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:49.574885 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c6239afd-204b-410b-90f5-b9f8f8a78701 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:49.575396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c6239afd-204b-410b-90f5-b9f8f8a78701 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:49.576262 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c6239afd-204b-410b-90f5-b9f8f8a78701 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:49.577418 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c6239afd-204b-410b-90f5-b9f8f8a78701 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:49.760941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-45c7415d-e606-42b7-8ed4-7331b3a4f963 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:49.771015 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-45c7415d-e606-42b7-8ed4-7331b3a4f963 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.258641 Apr 16 16:56:49.771579 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 467/946] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:49 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:50.161180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-de3ad794-288d-40c7-a943-6f630a76adfb tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:50.162049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-de3ad794-288d-40c7-a943-6f630a76adfb tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:50.172363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de3ad794-288d-40c7-a943-6f630a76adfb tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:50.173156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de3ad794-288d-40c7-a943-6f630a76adfb tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:50.174249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de3ad794-288d-40c7-a943-6f630a76adfb tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:50.174777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-de3ad794-288d-40c7-a943-6f630a76adfb tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:50.398992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-de3ad794-288d-40c7-a943-6f630a76adfb tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:50.409753 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-de3ad794-288d-40c7-a943-6f630a76adfb tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:50.411458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-de3ad794-288d-40c7-a943-6f630a76adfb tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:50.412674 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-de3ad794-288d-40c7-a943-6f630a76adfb tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1726 microversion: 2.20 time: 0.255736 Apr 16 16:56:50.413290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 468/947] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:50 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1726 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:56:50.418218 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7d877ce1-b4c4-42b3-b93a-5dc9d0c5e436 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:50.418833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7d877ce1-b4c4-42b3-b93a-5dc9d0c5e436 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:50.426874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d877ce1-b4c4-42b3-b93a-5dc9d0c5e436 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:50.427379 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d877ce1-b4c4-42b3-b93a-5dc9d0c5e436 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:50.428255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d877ce1-b4c4-42b3-b93a-5dc9d0c5e436 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:50.428768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d877ce1-b4c4-42b3-b93a-5dc9d0c5e436 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:50.613693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-7d877ce1-b4c4-42b3-b93a-5dc9d0c5e436 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lazy-loading 'services' on Instance uuid a0f254d3-c0d6-4c32-897b-e19f47934010 {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:56:50.764628 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7d877ce1-b4c4-42b3-b93a-5dc9d0c5e436 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "DELETE /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments/d42a8388-91e8-4b2c-875a-4be8ceb3d540" status: 202 len: 0 microversion: 2.1 time: 0.349716 Apr 16 16:56:50.765471 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 469/948] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 16:56:50 2021] DELETE /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments/d42a8388-91e8-4b2c-875a-4be8ceb3d540 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:56:50.911842 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-2da4ea19-223b-46ae-bb2a-a22ef035595b req-073291a9-1232-45fc-b8a2-b8aeac8197a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f254d3-c0d6-4c32-897b-e19f47934010", "tag": "48feea5a-19f4-4f16-80f8-5166404c8b45"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:50.913699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:56:50.913699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:56:50.924546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-2da4ea19-223b-46ae-bb2a-a22ef035595b req-073291a9-1232-45fc-b8a2-b8aeac8197a0 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:50.925056 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-2da4ea19-223b-46ae-bb2a-a22ef035595b req-073291a9-1232-45fc-b8a2-b8aeac8197a0 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:50.943404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-2da4ea19-223b-46ae-bb2a-a22ef035595b req-073291a9-1232-45fc-b8a2-b8aeac8197a0 service nova] Creating event network-changed:48feea5a-19f4-4f16-80f8-5166404c8b45 for instance a0f254d3-c0d6-4c32-897b-e19f47934010 on hv-cinder-73362 Apr 16 16:56:50.948712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-2da4ea19-223b-46ae-bb2a-a22ef035595b req-073291a9-1232-45fc-b8a2-b8aeac8197a0 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181520 Apr 16 16:56:50.949372 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 470/949] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:56:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:56:50.957366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-df5ba69a-8df4-4472-9248-7e7725786483 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:50.958545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-df5ba69a-8df4-4472-9248-7e7725786483 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:50.972634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-df5ba69a-8df4-4472-9248-7e7725786483 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:50.972634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-df5ba69a-8df4-4472-9248-7e7725786483 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:50.972634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-df5ba69a-8df4-4472-9248-7e7725786483 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:50.972634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-df5ba69a-8df4-4472-9248-7e7725786483 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:51.040580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-df5ba69a-8df4-4472-9248-7e7725786483 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087414 Apr 16 16:56:51.042364 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 471/950] 10.222.0.103 () {58 vars in 1297 bytes} [Fri Apr 16 16:56:50 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:56:51.051443 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e27d3e7d-e9dc-4835-839d-1d1081e50cce tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:51.052005 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e27d3e7d-e9dc-4835-839d-1d1081e50cce tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:51.060184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e27d3e7d-e9dc-4835-839d-1d1081e50cce tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:51.060683 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e27d3e7d-e9dc-4835-839d-1d1081e50cce tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:51.061679 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e27d3e7d-e9dc-4835-839d-1d1081e50cce tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:51.062205 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e27d3e7d-e9dc-4835-839d-1d1081e50cce tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:51.296484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e27d3e7d-e9dc-4835-839d-1d1081e50cce tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:51.305962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e27d3e7d-e9dc-4835-839d-1d1081e50cce tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1268 microversion: 2.1 time: 0.258572 Apr 16 16:56:51.306643 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 472/951] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:51 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1268 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:51.432860 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-33ff1b7e-c225-40d6-89bc-b9375e205d4a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:51.433559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-33ff1b7e-c225-40d6-89bc-b9375e205d4a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:51.441600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-33ff1b7e-c225-40d6-89bc-b9375e205d4a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:51.442096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-33ff1b7e-c225-40d6-89bc-b9375e205d4a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:51.442992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-33ff1b7e-c225-40d6-89bc-b9375e205d4a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:51.443471 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-33ff1b7e-c225-40d6-89bc-b9375e205d4a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:51.569783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c6239afd-204b-410b-90f5-b9f8f8a78701 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 37719 microversion: 2.1 time: 2.012525 Apr 16 16:56:51.571084 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 480/952] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:49 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 37719 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:51.742461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-33ff1b7e-c225-40d6-89bc-b9375e205d4a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:51.754969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-33ff1b7e-c225-40d6-89bc-b9375e205d4a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:51.756731 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-33ff1b7e-c225-40d6-89bc-b9375e205d4a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:51.758005 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-33ff1b7e-c225-40d6-89bc-b9375e205d4a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1726 microversion: 2.20 time: 0.329539 Apr 16 16:56:51.770812 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 473/953] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:51 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1726 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:56:52.055790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9b64d426-365c-4b9a-8e1e-5236978f1816 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:52.057618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9b64d426-365c-4b9a-8e1e-5236978f1816 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:52.066689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b64d426-365c-4b9a-8e1e-5236978f1816 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:52.067302 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b64d426-365c-4b9a-8e1e-5236978f1816 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:52.068218 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b64d426-365c-4b9a-8e1e-5236978f1816 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:52.068782 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b64d426-365c-4b9a-8e1e-5236978f1816 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:52.145891 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9b64d426-365c-4b9a-8e1e-5236978f1816 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094734 Apr 16 16:56:52.146727 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 481/954] 10.222.0.103 () {58 vars in 1297 bytes} [Fri Apr 16 16:56:52 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:56:52.325488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e964c071-918b-4402-8863-aa9253d3ddde tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:52.326195 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e964c071-918b-4402-8863-aa9253d3ddde tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:52.335971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e964c071-918b-4402-8863-aa9253d3ddde tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:52.336479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e964c071-918b-4402-8863-aa9253d3ddde tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:52.337378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e964c071-918b-4402-8863-aa9253d3ddde tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:52.337796 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e964c071-918b-4402-8863-aa9253d3ddde tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:52.564063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e964c071-918b-4402-8863-aa9253d3ddde tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:52.588873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-19b03746-42a0-4be4-bcf3-953795e4a0b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:52.590526 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-19b03746-42a0-4be4-bcf3-953795e4a0b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:52.595810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e964c071-918b-4402-8863-aa9253d3ddde tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1456 microversion: 2.1 time: 0.255009 Apr 16 16:56:52.597144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 474/955] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:52 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1456 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:52.598459 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-19b03746-42a0-4be4-bcf3-953795e4a0b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:52.599148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-19b03746-42a0-4be4-bcf3-953795e4a0b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:52.600179 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-19b03746-42a0-4be4-bcf3-953795e4a0b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:52.600978 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-19b03746-42a0-4be4-bcf3-953795e4a0b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:52.614478 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0a6bdeff-3225-49be-83df-9763db8a2397 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:52.615142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0a6bdeff-3225-49be-83df-9763db8a2397 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:52.624431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0a6bdeff-3225-49be-83df-9763db8a2397 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:52.624996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0a6bdeff-3225-49be-83df-9763db8a2397 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:52.626255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0a6bdeff-3225-49be-83df-9763db8a2397 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:52.626766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0a6bdeff-3225-49be-83df-9763db8a2397 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:52.709925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-19b03746-42a0-4be4-bcf3-953795e4a0b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 38144 microversion: 2.1 time: 0.129093 Apr 16 16:56:52.710956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 482/956] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:52 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 38144 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 16:56:52.779799 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d19dfacd-22cd-4ca8-9c34-488454521a37 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:52.781605 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d19dfacd-22cd-4ca8-9c34-488454521a37 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:52.793619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d19dfacd-22cd-4ca8-9c34-488454521a37 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:52.794507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d19dfacd-22cd-4ca8-9c34-488454521a37 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:52.796211 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d19dfacd-22cd-4ca8-9c34-488454521a37 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:52.797310 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d19dfacd-22cd-4ca8-9c34-488454521a37 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:52.886940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0a6bdeff-3225-49be-83df-9763db8a2397 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:52.900650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0a6bdeff-3225-49be-83df-9763db8a2397 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1456 microversion: 2.1 time: 0.289791 Apr 16 16:56:52.902803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 475/957] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:52 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1456 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:53.063993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d19dfacd-22cd-4ca8-9c34-488454521a37 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:53.073707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d19dfacd-22cd-4ca8-9c34-488454521a37 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:53.075470 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d19dfacd-22cd-4ca8-9c34-488454521a37 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:53.076791 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d19dfacd-22cd-4ca8-9c34-488454521a37 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1729 microversion: 2.20 time: 0.302593 Apr 16 16:56:53.077533 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 483/958] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:52 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1729 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:53.096402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3a897349-a48a-4aed-9175-9b0654798477 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f1bba34-0883-48dc-927a-d08649c1066e"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:53.097688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3a897349-a48a-4aed-9175-9b0654798477 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:53.105732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a897349-a48a-4aed-9175-9b0654798477 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:53.106245 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a897349-a48a-4aed-9175-9b0654798477 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:53.107124 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a897349-a48a-4aed-9175-9b0654798477 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:53.107639 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3a897349-a48a-4aed-9175-9b0654798477 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:53.159849 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6d31fe55-90c0-4a42-86de-c4e2f5367ce1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:53.161022 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6d31fe55-90c0-4a42-86de-c4e2f5367ce1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:53.169085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6d31fe55-90c0-4a42-86de-c4e2f5367ce1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:53.169596 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6d31fe55-90c0-4a42-86de-c4e2f5367ce1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:53.171125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6d31fe55-90c0-4a42-86de-c4e2f5367ce1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:53.171957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6d31fe55-90c0-4a42-86de-c4e2f5367ce1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:53.252661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6d31fe55-90c0-4a42-86de-c4e2f5367ce1 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097808 Apr 16 16:56:53.253453 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 484/959] 10.222.0.103 () {58 vars in 1297 bytes} [Fri Apr 16 16:56:53 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 16:56:53.264540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e06828d7-beeb-458d-b1a0-d3e52e765924 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:53.265320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e06828d7-beeb-458d-b1a0-d3e52e765924 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:53.273821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e06828d7-beeb-458d-b1a0-d3e52e765924 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:53.274337 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e06828d7-beeb-458d-b1a0-d3e52e765924 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:53.275196 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e06828d7-beeb-458d-b1a0-d3e52e765924 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:53.276047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e06828d7-beeb-458d-b1a0-d3e52e765924 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:53.456858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-e06828d7-beeb-458d-b1a0-d3e52e765924 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] HTTP exception thrown: Instance a0f254d3-c0d6-4c32-897b-e19f47934010 is not attached to volume d42a8388-91e8-4b2c-875a-4be8ceb3d540 Apr 16 16:56:53.457540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e06828d7-beeb-458d-b1a0-d3e52e765924 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Returning 404 to user: Instance a0f254d3-c0d6-4c32-897b-e19f47934010 is not attached to volume d42a8388-91e8-4b2c-875a-4be8ceb3d540 {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:56:53.458552 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e06828d7-beeb-458d-b1a0-d3e52e765924 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "DELETE /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments/d42a8388-91e8-4b2c-875a-4be8ceb3d540" status: 404 len: 154 microversion: 2.1 time: 0.198312 Apr 16 16:56:53.459177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 485/960] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 16:56:53 2021] DELETE /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010/os-volume_attachments/d42a8388-91e8-4b2c-875a-4be8ceb3d540 => generated 154 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 16:56:53.605001 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3a897349-a48a-4aed-9175-9b0654798477 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.513342 Apr 16 16:56:53.605876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 476/961] 10.222.0.103 () {62 vars in 1359 bytes} [Fri Apr 16 16:56:53 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/os-volume_attachments => generated 188 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:53.723904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-bd461814-5524-4cd8-b01d-aba5c1e35965 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:53.725166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-bd461814-5524-4cd8-b01d-aba5c1e35965 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:53.727146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4179f538-e881-4cbb-a413-8c3d134a747a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:53.727704 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4179f538-e881-4cbb-a413-8c3d134a747a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:53.735990 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bd461814-5524-4cd8-b01d-aba5c1e35965 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:53.736752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bd461814-5524-4cd8-b01d-aba5c1e35965 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:53.737811 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bd461814-5524-4cd8-b01d-aba5c1e35965 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:53.738569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-bd461814-5524-4cd8-b01d-aba5c1e35965 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:53.740236 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4179f538-e881-4cbb-a413-8c3d134a747a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:53.740768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4179f538-e881-4cbb-a413-8c3d134a747a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:53.741595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4179f538-e881-4cbb-a413-8c3d134a747a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:53.742081 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4179f538-e881-4cbb-a413-8c3d134a747a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:56.299784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-bd461814-5524-4cd8-b01d-aba5c1e35965 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 38144 microversion: 2.1 time: 2.579705 Apr 16 16:56:56.307101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 486/962] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:53 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 38144 bytes in 2582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:56.309523 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-66edc043-fc8c-4bf2-9fca-03bdc24961bd req-f20ae2c0-fb52-4dc9-ac8e-1e9cd36bc7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ed33ad-b824-4144-a51d-81ba74e24a4b", "tag": "2139fff4-2645-4ee4-90d3-2b1dcf4f8a76"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:56.311854 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:56:56.311854 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:56:56.321575 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-66edc043-fc8c-4bf2-9fca-03bdc24961bd req-f20ae2c0-fb52-4dc9-ac8e-1e9cd36bc7d9 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:56.322123 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-66edc043-fc8c-4bf2-9fca-03bdc24961bd req-f20ae2c0-fb52-4dc9-ac8e-1e9cd36bc7d9 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:56.341764 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-66edc043-fc8c-4bf2-9fca-03bdc24961bd req-f20ae2c0-fb52-4dc9-ac8e-1e9cd36bc7d9 service nova] Creating event network-changed:2139fff4-2645-4ee4-90d3-2b1dcf4f8a76 for instance a3ed33ad-b824-4144-a51d-81ba74e24a4b on hv-cinder-73362 Apr 16 16:56:56.347785 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-66edc043-fc8c-4bf2-9fca-03bdc24961bd req-f20ae2c0-fb52-4dc9-ac8e-1e9cd36bc7d9 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044809 Apr 16 16:56:56.348501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 487/963] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:56:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:56:56.448607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4179f538-e881-4cbb-a413-8c3d134a747a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "DELETE /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/os-volume_attachments/3f1bba34-0883-48dc-927a-d08649c1066e" status: 202 len: 0 microversion: 2.20 time: 2.725506 Apr 16 16:56:56.450042 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 477/964] 10.222.0.103 () {60 vars in 1452 bytes} [Fri Apr 16 16:56:53 2021] DELETE /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/os-volume_attachments/3f1bba34-0883-48dc-927a-d08649c1066e => generated 0 bytes in 2728 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:56:56.560173 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e8aae32b-8840-4974-afaa-2b437f205f64 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:56.560886 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e8aae32b-8840-4974-afaa-2b437f205f64 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:56.569742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e8aae32b-8840-4974-afaa-2b437f205f64 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:56.570217 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e8aae32b-8840-4974-afaa-2b437f205f64 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:56.571143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e8aae32b-8840-4974-afaa-2b437f205f64 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:56.571634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e8aae32b-8840-4974-afaa-2b437f205f64 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:56.741342 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e8aae32b-8840-4974-afaa-2b437f205f64 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action" status: 202 len: 0 microversion: 2.20 time: 0.185956 Apr 16 16:56:56.741975 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 488/965] 10.222.0.103 () {62 vars in 1314 bytes} [Fri Apr 16 16:56:56 2021] POST /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:56:56.751613 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-37c31c25-c563-4fad-97b5-0211a35e2385 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:56.752642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-37c31c25-c563-4fad-97b5-0211a35e2385 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:56.762010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-37c31c25-c563-4fad-97b5-0211a35e2385 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:56.762856 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-37c31c25-c563-4fad-97b5-0211a35e2385 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:56.764229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-37c31c25-c563-4fad-97b5-0211a35e2385 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:56.765002 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-37c31c25-c563-4fad-97b5-0211a35e2385 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:56.954133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-664d4f4b-bbef-47ab-beb3-53c892a71a8b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:56.955134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-664d4f4b-bbef-47ab-beb3-53c892a71a8b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:56.970601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-664d4f4b-bbef-47ab-beb3-53c892a71a8b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:56.971902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-664d4f4b-bbef-47ab-beb3-53c892a71a8b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:56.973103 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-664d4f4b-bbef-47ab-beb3-53c892a71a8b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:56.980989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-664d4f4b-bbef-47ab-beb3-53c892a71a8b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:57.049616 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-37c31c25-c563-4fad-97b5-0211a35e2385 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:57.062661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-37c31c25-c563-4fad-97b5-0211a35e2385 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:57.064507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-37c31c25-c563-4fad-97b5-0211a35e2385 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:57.066033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-37c31c25-c563-4fad-97b5-0211a35e2385 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1677 microversion: 2.20 time: 0.318954 Apr 16 16:56:57.067402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 478/966] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:56 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1677 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:57.133813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-664d4f4b-bbef-47ab-beb3-53c892a71a8b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:56:57.288923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-664d4f4b-bbef-47ab-beb3-53c892a71a8b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "DELETE /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 204 len: 0 microversion: 2.1 time: 0.338869 Apr 16 16:56:57.289879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 489/967] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:56:56 2021] DELETE /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:56:57.305570 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-132a2b23-e163-4b83-9bd6-2a8e0a7802d3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:57.306958 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-132a2b23-e163-4b83-9bd6-2a8e0a7802d3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:57.318141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dce968e6-1c3b-41b0-91a1-6867f00d24b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:57.319517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dce968e6-1c3b-41b0-91a1-6867f00d24b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:57.324366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-132a2b23-e163-4b83-9bd6-2a8e0a7802d3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:57.325618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-132a2b23-e163-4b83-9bd6-2a8e0a7802d3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:57.327472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-132a2b23-e163-4b83-9bd6-2a8e0a7802d3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:57.329062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-132a2b23-e163-4b83-9bd6-2a8e0a7802d3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:57.350044 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dce968e6-1c3b-41b0-91a1-6867f00d24b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:57.350566 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dce968e6-1c3b-41b0-91a1-6867f00d24b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:57.351437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dce968e6-1c3b-41b0-91a1-6867f00d24b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:57.351939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dce968e6-1c3b-41b0-91a1-6867f00d24b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:57.542194 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dce968e6-1c3b-41b0-91a1-6867f00d24b7 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 38165 microversion: 2.1 time: 0.229359 Apr 16 16:56:57.547402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 490/968] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:57 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 38165 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:56:57.639192 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-132a2b23-e163-4b83-9bd6-2a8e0a7802d3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:57.652279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-132a2b23-e163-4b83-9bd6-2a8e0a7802d3 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1556 microversion: 2.1 time: 0.357164 Apr 16 16:56:57.652992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 479/969] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:57 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1556 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:56:58.089446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-45b2cc4a-251d-4660-9eee-a57978d63aa3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:58.090227 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-45b2cc4a-251d-4660-9eee-a57978d63aa3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:58.099798 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45b2cc4a-251d-4660-9eee-a57978d63aa3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:58.100294 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45b2cc4a-251d-4660-9eee-a57978d63aa3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:58.101145 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45b2cc4a-251d-4660-9eee-a57978d63aa3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:58.101633 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-45b2cc4a-251d-4660-9eee-a57978d63aa3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:58.345859 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-45b2cc4a-251d-4660-9eee-a57978d63aa3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:58.357169 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-45b2cc4a-251d-4660-9eee-a57978d63aa3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:58.359143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-45b2cc4a-251d-4660-9eee-a57978d63aa3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:58.360404 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-45b2cc4a-251d-4660-9eee-a57978d63aa3 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1677 microversion: 2.20 time: 0.276074 Apr 16 16:56:58.361025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 491/970] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:58 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1677 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:56:58.555634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4ce83935-2dd3-4dc8-959f-dfb579536f53 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:56:58.556756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4ce83935-2dd3-4dc8-959f-dfb579536f53 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:58.565907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4ce83935-2dd3-4dc8-959f-dfb579536f53 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:58.566431 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4ce83935-2dd3-4dc8-959f-dfb579536f53 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:58.567276 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4ce83935-2dd3-4dc8-959f-dfb579536f53 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:58.567760 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4ce83935-2dd3-4dc8-959f-dfb579536f53 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:58.672346 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5dcf1c88-15bf-4272-bb6c-e7866d2a671b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:58.673059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5dcf1c88-15bf-4272-bb6c-e7866d2a671b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:58.680988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5dcf1c88-15bf-4272-bb6c-e7866d2a671b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:58.681498 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5dcf1c88-15bf-4272-bb6c-e7866d2a671b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:58.682367 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5dcf1c88-15bf-4272-bb6c-e7866d2a671b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:58.682867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5dcf1c88-15bf-4272-bb6c-e7866d2a671b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:58.904279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5dcf1c88-15bf-4272-bb6c-e7866d2a671b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:58.913373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5dcf1c88-15bf-4272-bb6c-e7866d2a671b tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1556 microversion: 2.1 time: 0.245576 Apr 16 16:56:58.914011 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 492/971] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:58 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1556 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:56:59.380593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6b392547-5676-4f1d-8de3-187eb47a16af tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:59.381251 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6b392547-5676-4f1d-8de3-187eb47a16af tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:59.391323 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6b392547-5676-4f1d-8de3-187eb47a16af tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:59.391956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6b392547-5676-4f1d-8de3-187eb47a16af tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:59.392958 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6b392547-5676-4f1d-8de3-187eb47a16af tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:59.393583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6b392547-5676-4f1d-8de3-187eb47a16af tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:59.619993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6b392547-5676-4f1d-8de3-187eb47a16af tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:59.629846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6b392547-5676-4f1d-8de3-187eb47a16af tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:59.631548 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6b392547-5676-4f1d-8de3-187eb47a16af tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:56:59.632755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6b392547-5676-4f1d-8de3-187eb47a16af tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1677 microversion: 2.20 time: 0.256311 Apr 16 16:56:59.633359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 493/972] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:56:59 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:56:59.931869 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a8c9c13b-e9eb-4ef6-a761-5ea9035d7457 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:56:59.932451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a8c9c13b-e9eb-4ef6-a761-5ea9035d7457 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:56:59.940587 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a8c9c13b-e9eb-4ef6-a761-5ea9035d7457 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:59.941141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a8c9c13b-e9eb-4ef6-a761-5ea9035d7457 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:56:59.941983 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a8c9c13b-e9eb-4ef6-a761-5ea9035d7457 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:56:59.942510 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a8c9c13b-e9eb-4ef6-a761-5ea9035d7457 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:00.395692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a8c9c13b-e9eb-4ef6-a761-5ea9035d7457 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:00.406125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a8c9c13b-e9eb-4ef6-a761-5ea9035d7457 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1556 microversion: 2.1 time: 0.478169 Apr 16 16:57:00.406778 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 494/973] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:56:59 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1556 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:57:00.654184 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3d1e4f1b-3573-4b9c-83b7-0a7ddd66097a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:00.655417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3d1e4f1b-3573-4b9c-83b7-0a7ddd66097a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:00.663945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d1e4f1b-3573-4b9c-83b7-0a7ddd66097a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:00.664454 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d1e4f1b-3573-4b9c-83b7-0a7ddd66097a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:00.665324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d1e4f1b-3573-4b9c-83b7-0a7ddd66097a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:00.665842 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3d1e4f1b-3573-4b9c-83b7-0a7ddd66097a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:00.754000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4ce83935-2dd3-4dc8-959f-dfb579536f53 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action" status: 200 len: 38275 microversion: 2.1 time: 2.202180 Apr 16 16:57:00.755296 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 480/974] 10.222.0.103 () {60 vars in 1273 bytes} [Fri Apr 16 16:56:58 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/action => generated 38275 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 16:57:00.767333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-72d9115d-c15d-4c18-ae9d-8812db17ef15 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:00.767999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-72d9115d-c15d-4c18-ae9d-8812db17ef15 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:00.777169 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-72d9115d-c15d-4c18-ae9d-8812db17ef15 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:00.777680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-72d9115d-c15d-4c18-ae9d-8812db17ef15 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:00.778566 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-72d9115d-c15d-4c18-ae9d-8812db17ef15 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:00.779061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-72d9115d-c15d-4c18-ae9d-8812db17ef15 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:00.846630 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-72d9115d-c15d-4c18-ae9d-8812db17ef15 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/ips" status: 200 len: 147 microversion: 2.1 time: 0.084136 Apr 16 16:57:00.851831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 481/975] 10.222.0.103 () {58 vars in 1243 bytes} [Fri Apr 16 16:57:00 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/ips => generated 147 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:57:00.893862 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3d1e4f1b-3573-4b9c-83b7-0a7ddd66097a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:00.904812 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3d1e4f1b-3573-4b9c-83b7-0a7ddd66097a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:00.906660 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3d1e4f1b-3573-4b9c-83b7-0a7ddd66097a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:00.908354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3d1e4f1b-3573-4b9c-83b7-0a7ddd66097a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1677 microversion: 2.20 time: 0.258661 Apr 16 16:57:00.909268 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 495/976] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:00 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1677 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:57:01.425591 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-be06846f-9a51-46fc-b855-4ffa8f7b0ccc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:01.426316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-be06846f-9a51-46fc-b855-4ffa8f7b0ccc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:01.434618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be06846f-9a51-46fc-b855-4ffa8f7b0ccc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:01.435122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be06846f-9a51-46fc-b855-4ffa8f7b0ccc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:01.436828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be06846f-9a51-46fc-b855-4ffa8f7b0ccc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:01.436989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be06846f-9a51-46fc-b855-4ffa8f7b0ccc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:01.663307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-be06846f-9a51-46fc-b855-4ffa8f7b0ccc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:01.672960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-be06846f-9a51-46fc-b855-4ffa8f7b0ccc tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1556 microversion: 2.1 time: 0.251424 Apr 16 16:57:01.673538 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 482/977] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:01 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:01.929249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-01b87a3c-bedd-40ba-9c3d-5c8834782300 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:01.929979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-01b87a3c-bedd-40ba-9c3d-5c8834782300 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:01.939454 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-01b87a3c-bedd-40ba-9c3d-5c8834782300 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:01.940088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-01b87a3c-bedd-40ba-9c3d-5c8834782300 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:01.941151 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-01b87a3c-bedd-40ba-9c3d-5c8834782300 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:01.941869 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-01b87a3c-bedd-40ba-9c3d-5c8834782300 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:02.191409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-01b87a3c-bedd-40ba-9c3d-5c8834782300 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:02.207625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-01b87a3c-bedd-40ba-9c3d-5c8834782300 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:02.209312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-01b87a3c-bedd-40ba-9c3d-5c8834782300 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:02.210997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-01b87a3c-bedd-40ba-9c3d-5c8834782300 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.285631 Apr 16 16:57:02.214341 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 496/978] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:01 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:02.453878 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f0e9f754-1630-4107-bacb-340a91427462 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "967a20f8-7aa8-4b16-9bab-5fd64f4429e3"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:57:02.455124 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f0e9f754-1630-4107-bacb-340a91427462 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:02.464651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f0e9f754-1630-4107-bacb-340a91427462 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:02.465148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f0e9f754-1630-4107-bacb-340a91427462 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:02.465993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f0e9f754-1630-4107-bacb-340a91427462 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:02.466489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f0e9f754-1630-4107-bacb-340a91427462 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:02.691325 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-11f3e431-4e07-4590-ad25-01becf5379c9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:02.692181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-11f3e431-4e07-4590-ad25-01becf5379c9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:02.705843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-11f3e431-4e07-4590-ad25-01becf5379c9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:02.706680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-11f3e431-4e07-4590-ad25-01becf5379c9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:02.709943 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-11f3e431-4e07-4590-ad25-01becf5379c9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:02.710694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-11f3e431-4e07-4590-ad25-01becf5379c9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:02.952466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-11f3e431-4e07-4590-ad25-01becf5379c9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:02.961355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f0e9f754-1630-4107-bacb-340a91427462 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511529 Apr 16 16:57:02.962458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 483/979] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:57:02 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:57:02.962964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-11f3e431-4e07-4590-ad25-01becf5379c9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1556 microversion: 2.1 time: 0.275422 Apr 16 16:57:02.964197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 497/980] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:02 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1556 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:57:03.245078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-169d0d5c-6079-4a20-9ba7-c12f928c4930 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:03.246366 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-169d0d5c-6079-4a20-9ba7-c12f928c4930 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:03.261028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-169d0d5c-6079-4a20-9ba7-c12f928c4930 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:03.261839 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-169d0d5c-6079-4a20-9ba7-c12f928c4930 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:03.263057 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-169d0d5c-6079-4a20-9ba7-c12f928c4930 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:03.264241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-169d0d5c-6079-4a20-9ba7-c12f928c4930 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:03.593739 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-169d0d5c-6079-4a20-9ba7-c12f928c4930 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:03.604440 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-169d0d5c-6079-4a20-9ba7-c12f928c4930 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:03.606208 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-169d0d5c-6079-4a20-9ba7-c12f928c4930 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:03.608140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-169d0d5c-6079-4a20-9ba7-c12f928c4930 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.378842 Apr 16 16:57:03.610339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 484/981] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:03 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:03.743594 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-e4069625-3cfe-4feb-a17b-d1d34d21d088 req-22db9b44-e5e6-467e-84f1-63c529d2f8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f254d3-c0d6-4c32-897b-e19f47934010", "name": "network-vif-deleted", "tag": "48feea5a-19f4-4f16-80f8-5166404c8b45"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:57:03.745680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:57:03.745680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:57:03.754784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-e4069625-3cfe-4feb-a17b-d1d34d21d088 req-22db9b44-e5e6-467e-84f1-63c529d2f8d7 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:03.755263 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-e4069625-3cfe-4feb-a17b-d1d34d21d088 req-22db9b44-e5e6-467e-84f1-63c529d2f8d7 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:03.774109 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-e4069625-3cfe-4feb-a17b-d1d34d21d088 req-22db9b44-e5e6-467e-84f1-63c529d2f8d7 service nova] Creating event network-vif-deleted:48feea5a-19f4-4f16-80f8-5166404c8b45 for instance a0f254d3-c0d6-4c32-897b-e19f47934010 on hv-cinder-73362 Apr 16 16:57:03.780405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-e4069625-3cfe-4feb-a17b-d1d34d21d088 req-22db9b44-e5e6-467e-84f1-63c529d2f8d7 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040100 Apr 16 16:57:03.781948 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 498/982] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:57:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:57:03.981676 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2610c0ba-58bb-4d5c-a1a0-870ced4bf3bf tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:03.982393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2610c0ba-58bb-4d5c-a1a0-870ced4bf3bf tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:03.991553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2610c0ba-58bb-4d5c-a1a0-870ced4bf3bf tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:03.992067 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2610c0ba-58bb-4d5c-a1a0-870ced4bf3bf tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:03.992930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2610c0ba-58bb-4d5c-a1a0-870ced4bf3bf tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:03.993414 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2610c0ba-58bb-4d5c-a1a0-870ced4bf3bf tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:04.161391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2610c0ba-58bb-4d5c-a1a0-870ced4bf3bf tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:04.174792 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2610c0ba-58bb-4d5c-a1a0-870ced4bf3bf tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1514 microversion: 2.1 time: 0.196874 Apr 16 16:57:04.175876 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 485/983] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:03 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:04.630397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dbe680c9-2fda-4fab-82b2-5a0f8f0fe30a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:04.631290 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dbe680c9-2fda-4fab-82b2-5a0f8f0fe30a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:04.640355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dbe680c9-2fda-4fab-82b2-5a0f8f0fe30a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:04.640869 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dbe680c9-2fda-4fab-82b2-5a0f8f0fe30a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:04.641733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dbe680c9-2fda-4fab-82b2-5a0f8f0fe30a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:04.642220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dbe680c9-2fda-4fab-82b2-5a0f8f0fe30a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:04.875963 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dbe680c9-2fda-4fab-82b2-5a0f8f0fe30a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:04.885897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dbe680c9-2fda-4fab-82b2-5a0f8f0fe30a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:04.887542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dbe680c9-2fda-4fab-82b2-5a0f8f0fe30a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:04.888937 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dbe680c9-2fda-4fab-82b2-5a0f8f0fe30a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.263181 Apr 16 16:57:04.889373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 499/984] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:04 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 16:57:05.193908 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e212228a-3060-43fc-9499-5f11dba0ba06 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:05.194535 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e212228a-3060-43fc-9499-5f11dba0ba06 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:05.203269 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e212228a-3060-43fc-9499-5f11dba0ba06 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:05.203779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e212228a-3060-43fc-9499-5f11dba0ba06 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:05.204639 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e212228a-3060-43fc-9499-5f11dba0ba06 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:05.205186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e212228a-3060-43fc-9499-5f11dba0ba06 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:05.356803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e212228a-3060-43fc-9499-5f11dba0ba06 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:05.369890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e212228a-3060-43fc-9499-5f11dba0ba06 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1514 microversion: 2.1 time: 0.180019 Apr 16 16:57:05.370573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 486/985] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:05 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:05.909164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-06173d85-fffe-4536-9b38-8c5250dc8c13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:05.910016 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-06173d85-fffe-4536-9b38-8c5250dc8c13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:05.918314 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-06173d85-fffe-4536-9b38-8c5250dc8c13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:05.918956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-06173d85-fffe-4536-9b38-8c5250dc8c13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:05.919898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-06173d85-fffe-4536-9b38-8c5250dc8c13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:05.921107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-06173d85-fffe-4536-9b38-8c5250dc8c13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:06.168075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-06173d85-fffe-4536-9b38-8c5250dc8c13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:06.179918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-06173d85-fffe-4536-9b38-8c5250dc8c13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:06.181857 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-06173d85-fffe-4536-9b38-8c5250dc8c13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:06.183139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-06173d85-fffe-4536-9b38-8c5250dc8c13 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.278675 Apr 16 16:57:06.184210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 500/986] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:05 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:06.395273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a7d75cf8-a983-47da-9a75-cd39d92e31b0 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:06.397100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a7d75cf8-a983-47da-9a75-cd39d92e31b0 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:06.410747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7d75cf8-a983-47da-9a75-cd39d92e31b0 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:06.411810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7d75cf8-a983-47da-9a75-cd39d92e31b0 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:06.413100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7d75cf8-a983-47da-9a75-cd39d92e31b0 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:06.415138 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a7d75cf8-a983-47da-9a75-cd39d92e31b0 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:06.579910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a7d75cf8-a983-47da-9a75-cd39d92e31b0 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:06.590638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a7d75cf8-a983-47da-9a75-cd39d92e31b0 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1514 microversion: 2.1 time: 0.201580 Apr 16 16:57:06.592375 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 487/987] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:06 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:57:07.203777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-134dddec-158b-4a8e-b6f1-b5e52cdd733f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:07.204456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-134dddec-158b-4a8e-b6f1-b5e52cdd733f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:07.212722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-134dddec-158b-4a8e-b6f1-b5e52cdd733f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:07.213233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-134dddec-158b-4a8e-b6f1-b5e52cdd733f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:07.214104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-134dddec-158b-4a8e-b6f1-b5e52cdd733f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:07.214721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-134dddec-158b-4a8e-b6f1-b5e52cdd733f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:07.467592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-134dddec-158b-4a8e-b6f1-b5e52cdd733f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:07.489979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-134dddec-158b-4a8e-b6f1-b5e52cdd733f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:07.491852 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-134dddec-158b-4a8e-b6f1-b5e52cdd733f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:07.493017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-134dddec-158b-4a8e-b6f1-b5e52cdd733f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.293884 Apr 16 16:57:07.493693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 501/988] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:07 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:07.612807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5f392e07-e33e-4997-a29e-4e4d2aa82a70 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:07.613641 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5f392e07-e33e-4997-a29e-4e4d2aa82a70 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:07.624042 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f392e07-e33e-4997-a29e-4e4d2aa82a70 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:07.625233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f392e07-e33e-4997-a29e-4e4d2aa82a70 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:07.626466 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f392e07-e33e-4997-a29e-4e4d2aa82a70 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:07.627217 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5f392e07-e33e-4997-a29e-4e4d2aa82a70 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:07.799503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5f392e07-e33e-4997-a29e-4e4d2aa82a70 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:07.808984 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5f392e07-e33e-4997-a29e-4e4d2aa82a70 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1514 microversion: 2.1 time: 0.202164 Apr 16 16:57:07.809762 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 488/989] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:07 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:08.515980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ed69bb08-e941-48e2-acfb-e826b97b9bb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:08.517444 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ed69bb08-e941-48e2-acfb-e826b97b9bb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:08.525867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed69bb08-e941-48e2-acfb-e826b97b9bb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:08.526397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed69bb08-e941-48e2-acfb-e826b97b9bb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:08.527484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed69bb08-e941-48e2-acfb-e826b97b9bb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:08.527977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed69bb08-e941-48e2-acfb-e826b97b9bb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:08.781263 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ed69bb08-e941-48e2-acfb-e826b97b9bb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:08.791810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ed69bb08-e941-48e2-acfb-e826b97b9bb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:08.793492 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ed69bb08-e941-48e2-acfb-e826b97b9bb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:08.796056 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ed69bb08-e941-48e2-acfb-e826b97b9bb1 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.284220 Apr 16 16:57:08.796883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 502/990] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:08 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:08.828472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0e5b8111-b7c4-484b-9905-a6655700756d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:08.829180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0e5b8111-b7c4-484b-9905-a6655700756d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:08.837304 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e5b8111-b7c4-484b-9905-a6655700756d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:08.837819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e5b8111-b7c4-484b-9905-a6655700756d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:08.838711 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e5b8111-b7c4-484b-9905-a6655700756d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:08.839203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0e5b8111-b7c4-484b-9905-a6655700756d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:08.975806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0e5b8111-b7c4-484b-9905-a6655700756d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:08.987430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0e5b8111-b7c4-484b-9905-a6655700756d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1514 microversion: 2.1 time: 0.163026 Apr 16 16:57:08.988208 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 489/991] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:08 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:09.816737 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9cda708f-3ab6-42d2-bd5e-1b688d7dec2a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:09.817412 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9cda708f-3ab6-42d2-bd5e-1b688d7dec2a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:09.825814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9cda708f-3ab6-42d2-bd5e-1b688d7dec2a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:09.827185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9cda708f-3ab6-42d2-bd5e-1b688d7dec2a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:09.829677 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9cda708f-3ab6-42d2-bd5e-1b688d7dec2a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:09.830601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9cda708f-3ab6-42d2-bd5e-1b688d7dec2a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:10.015576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d4757a99-9249-40b6-9322-d35291ac8c32 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:10.016244 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d4757a99-9249-40b6-9322-d35291ac8c32 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:10.036144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4757a99-9249-40b6-9322-d35291ac8c32 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:10.036545 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4757a99-9249-40b6-9322-d35291ac8c32 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:10.037610 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4757a99-9249-40b6-9322-d35291ac8c32 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:10.038267 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d4757a99-9249-40b6-9322-d35291ac8c32 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:10.082936 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9cda708f-3ab6-42d2-bd5e-1b688d7dec2a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:10.094650 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9cda708f-3ab6-42d2-bd5e-1b688d7dec2a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:10.097413 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9cda708f-3ab6-42d2-bd5e-1b688d7dec2a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:10.099199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9cda708f-3ab6-42d2-bd5e-1b688d7dec2a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.286379 Apr 16 16:57:10.099810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 503/992] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:09 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:10.175942 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d4757a99-9249-40b6-9322-d35291ac8c32 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:10.186060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d4757a99-9249-40b6-9322-d35291ac8c32 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1514 microversion: 2.1 time: 0.173975 Apr 16 16:57:10.187080 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 490/993] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:10 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:11.120659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1c2739d1-0f2f-4d1a-acc8-1f1fffb412d7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:11.121322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-1c2739d1-0f2f-4d1a-acc8-1f1fffb412d7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:11.130259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c2739d1-0f2f-4d1a-acc8-1f1fffb412d7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:11.130810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c2739d1-0f2f-4d1a-acc8-1f1fffb412d7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:11.131652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c2739d1-0f2f-4d1a-acc8-1f1fffb412d7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:11.132141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-1c2739d1-0f2f-4d1a-acc8-1f1fffb412d7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:11.204999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8875ec59-d8b3-4abc-b22d-55e8b8bc4aa4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:11.205671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8875ec59-d8b3-4abc-b22d-55e8b8bc4aa4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:11.214789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8875ec59-d8b3-4abc-b22d-55e8b8bc4aa4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:11.215299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8875ec59-d8b3-4abc-b22d-55e8b8bc4aa4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:11.216148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8875ec59-d8b3-4abc-b22d-55e8b8bc4aa4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:11.216642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8875ec59-d8b3-4abc-b22d-55e8b8bc4aa4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:11.365135 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8875ec59-d8b3-4abc-b22d-55e8b8bc4aa4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:11.375589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8875ec59-d8b3-4abc-b22d-55e8b8bc4aa4 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1514 microversion: 2.1 time: 0.174796 Apr 16 16:57:11.376233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 491/994] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:11 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:11.430036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1c2739d1-0f2f-4d1a-acc8-1f1fffb412d7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:11.442210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1c2739d1-0f2f-4d1a-acc8-1f1fffb412d7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:11.444234 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-1c2739d1-0f2f-4d1a-acc8-1f1fffb412d7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:11.445867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1c2739d1-0f2f-4d1a-acc8-1f1fffb412d7 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.329279 Apr 16 16:57:11.446736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 504/995] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:11 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:12.394683 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2079d706-ee25-4f18-95fb-c415c37b5b0c tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:12.396037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2079d706-ee25-4f18-95fb-c415c37b5b0c tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:12.405951 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2079d706-ee25-4f18-95fb-c415c37b5b0c tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:12.406997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2079d706-ee25-4f18-95fb-c415c37b5b0c tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:12.408618 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2079d706-ee25-4f18-95fb-c415c37b5b0c tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:12.409503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2079d706-ee25-4f18-95fb-c415c37b5b0c tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:12.467956 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-08a4c0d7-3ee1-4ed5-99ec-90d8cf51625e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:12.468767 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-08a4c0d7-3ee1-4ed5-99ec-90d8cf51625e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:12.476985 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08a4c0d7-3ee1-4ed5-99ec-90d8cf51625e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:12.477497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08a4c0d7-3ee1-4ed5-99ec-90d8cf51625e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:12.478379 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08a4c0d7-3ee1-4ed5-99ec-90d8cf51625e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:12.478886 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-08a4c0d7-3ee1-4ed5-99ec-90d8cf51625e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:12.557847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2079d706-ee25-4f18-95fb-c415c37b5b0c tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:12.567457 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2079d706-ee25-4f18-95fb-c415c37b5b0c tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1514 microversion: 2.1 time: 0.176809 Apr 16 16:57:12.568297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 492/996] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:12 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:12.731430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-08a4c0d7-3ee1-4ed5-99ec-90d8cf51625e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:12.742554 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-08a4c0d7-3ee1-4ed5-99ec-90d8cf51625e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:12.744281 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-08a4c0d7-3ee1-4ed5-99ec-90d8cf51625e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:12.746320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-08a4c0d7-3ee1-4ed5-99ec-90d8cf51625e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.282816 Apr 16 16:57:12.747417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 505/997] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:12 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:13.586766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-61d9cb08-81f8-4d3e-8848-b74c374bc31d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:13.587470 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-61d9cb08-81f8-4d3e-8848-b74c374bc31d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:13.596271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-61d9cb08-81f8-4d3e-8848-b74c374bc31d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:13.596788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-61d9cb08-81f8-4d3e-8848-b74c374bc31d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:13.597686 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-61d9cb08-81f8-4d3e-8848-b74c374bc31d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:13.598212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-61d9cb08-81f8-4d3e-8848-b74c374bc31d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:13.730496 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-61d9cb08-81f8-4d3e-8848-b74c374bc31d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:13.741386 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-61d9cb08-81f8-4d3e-8848-b74c374bc31d tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1514 microversion: 2.1 time: 0.158726 Apr 16 16:57:13.742320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 493/998] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:13 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:13.773447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e57cdb68-3385-4fa3-82b9-a66c3f49ad50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:13.774106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e57cdb68-3385-4fa3-82b9-a66c3f49ad50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:13.782726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e57cdb68-3385-4fa3-82b9-a66c3f49ad50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:13.783215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e57cdb68-3385-4fa3-82b9-a66c3f49ad50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:13.784318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e57cdb68-3385-4fa3-82b9-a66c3f49ad50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:13.785033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e57cdb68-3385-4fa3-82b9-a66c3f49ad50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:14.016664 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e57cdb68-3385-4fa3-82b9-a66c3f49ad50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:14.027509 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e57cdb68-3385-4fa3-82b9-a66c3f49ad50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:14.028663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e57cdb68-3385-4fa3-82b9-a66c3f49ad50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:14.030000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e57cdb68-3385-4fa3-82b9-a66c3f49ad50 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.260903 Apr 16 16:57:14.030670 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 506/999] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:13 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:14.759937 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b725148c-df66-458b-b1db-577cefb7e7b9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:14.760614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b725148c-df66-458b-b1db-577cefb7e7b9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:14.768773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b725148c-df66-458b-b1db-577cefb7e7b9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:14.769374 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b725148c-df66-458b-b1db-577cefb7e7b9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:14.772644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b725148c-df66-458b-b1db-577cefb7e7b9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:14.773359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b725148c-df66-458b-b1db-577cefb7e7b9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:14.902867 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b725148c-df66-458b-b1db-577cefb7e7b9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8fdc3332504f689fb00135845b2ad4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0944f6a6bc094a1db167f95dea7b6570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:14.912651 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b725148c-df66-458b-b1db-577cefb7e7b9 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 200 len: 1346 microversion: 2.1 time: 0.156723 Apr 16 16:57:14.913293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 494/1000] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:14 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 1346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:15.051888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-742113c5-297d-416c-bd34-7029df656516 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:15.052465 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-742113c5-297d-416c-bd34-7029df656516 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:15.060939 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-742113c5-297d-416c-bd34-7029df656516 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:15.061515 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-742113c5-297d-416c-bd34-7029df656516 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:15.062329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-742113c5-297d-416c-bd34-7029df656516 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:15.062817 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-742113c5-297d-416c-bd34-7029df656516 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:15.287721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-742113c5-297d-416c-bd34-7029df656516 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:15.298621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-742113c5-297d-416c-bd34-7029df656516 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:15.300393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-742113c5-297d-416c-bd34-7029df656516 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:15.301620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-742113c5-297d-416c-bd34-7029df656516 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.253953 Apr 16 16:57:15.302340 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 507/1001] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:15 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:15.931524 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9f47e01a-7375-49b4-9cf4-9e1edd588491 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:15.932186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9f47e01a-7375-49b4-9cf4-9e1edd588491 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] [instance: a0f254d3-c0d6-4c32-897b-e19f47934010] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:15.940761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f47e01a-7375-49b4-9cf4-9e1edd588491 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:15.941278 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f47e01a-7375-49b4-9cf4-9e1edd588491 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:15.942096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f47e01a-7375-49b4-9cf4-9e1edd588491 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:15.942608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9f47e01a-7375-49b4-9cf4-9e1edd588491 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:15.995274 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-9f47e01a-7375-49b4-9cf4-9e1edd588491 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] HTTP exception thrown: Instance a0f254d3-c0d6-4c32-897b-e19f47934010 could not be found. Apr 16 16:57:15.995940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9f47e01a-7375-49b4-9cf4-9e1edd588491 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Returning 404 to user: Instance a0f254d3-c0d6-4c32-897b-e19f47934010 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:57:15.996834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9f47e01a-7375-49b4-9cf4-9e1edd588491 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010" status: 404 len: 111 microversion: 2.1 time: 0.069767 Apr 16 16:57:15.997461 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 495/1002] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:15 2021] GET /compute/v2.1/servers/a0f254d3-c0d6-4c32-897b-e19f47934010 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:57:16.007779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1b909a74-c212-423f-92b7-3a9678522f95 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] Calling method '.version_select at 0x7f0d46215400>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:16.024447 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1b909a74-c212-423f-92b7-3a9678522f95 tempest-TestMinimumBasicScenario-682626309 tempest-TestMinimumBasicScenario-682626309-project] 10.222.0.103 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1595167525" status: 202 len: 0 microversion: 2.1 time: 0.021239 Apr 16 16:57:16.025085 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 508/1003] 10.222.0.103 () {58 vars in 1267 bytes} [Fri Apr 16 16:57:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1595167525 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:57:16.322268 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-30400f97-4595-45b2-b92d-808e1aac3f05 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:16.322926 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-30400f97-4595-45b2-b92d-808e1aac3f05 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:16.331107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-30400f97-4595-45b2-b92d-808e1aac3f05 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:16.331578 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-30400f97-4595-45b2-b92d-808e1aac3f05 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:16.332411 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-30400f97-4595-45b2-b92d-808e1aac3f05 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:16.332902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-30400f97-4595-45b2-b92d-808e1aac3f05 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:16.568442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-30400f97-4595-45b2-b92d-808e1aac3f05 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:16.584070 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-30400f97-4595-45b2-b92d-808e1aac3f05 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:16.585790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-30400f97-4595-45b2-b92d-808e1aac3f05 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:16.587412 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-30400f97-4595-45b2-b92d-808e1aac3f05 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.269524 Apr 16 16:57:16.588017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 496/1004] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:16 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:17.609029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-12c31969-c09d-41dc-b8bc-01b5b7a02a0a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:17.609821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-12c31969-c09d-41dc-b8bc-01b5b7a02a0a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:17.617881 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-12c31969-c09d-41dc-b8bc-01b5b7a02a0a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:17.618473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-12c31969-c09d-41dc-b8bc-01b5b7a02a0a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:17.619699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-12c31969-c09d-41dc-b8bc-01b5b7a02a0a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:17.620208 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-12c31969-c09d-41dc-b8bc-01b5b7a02a0a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:17.885276 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-12c31969-c09d-41dc-b8bc-01b5b7a02a0a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:17.897306 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-12c31969-c09d-41dc-b8bc-01b5b7a02a0a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:17.899066 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-12c31969-c09d-41dc-b8bc-01b5b7a02a0a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:17.900655 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-12c31969-c09d-41dc-b8bc-01b5b7a02a0a tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.295889 Apr 16 16:57:17.901627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 509/1005] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:17 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:18.920874 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5077686c-135e-45f7-b8b6-b2ee18a55d99 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:18.921542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5077686c-135e-45f7-b8b6-b2ee18a55d99 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:18.929721 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5077686c-135e-45f7-b8b6-b2ee18a55d99 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:18.930231 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5077686c-135e-45f7-b8b6-b2ee18a55d99 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:18.931134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5077686c-135e-45f7-b8b6-b2ee18a55d99 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:18.931630 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5077686c-135e-45f7-b8b6-b2ee18a55d99 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:19.152303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5077686c-135e-45f7-b8b6-b2ee18a55d99 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:19.162215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5077686c-135e-45f7-b8b6-b2ee18a55d99 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:19.163948 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5077686c-135e-45f7-b8b6-b2ee18a55d99 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:19.165157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5077686c-135e-45f7-b8b6-b2ee18a55d99 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.248475 Apr 16 16:57:19.165769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 497/1006] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:18 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:19.580256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-3450e732-6104-4c19-9939-444c8a937153 req-81470a9a-0d5d-48b3-82b6-7fbff29d002b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a606efe-c285-436f-9d27-d09708bc4564", "name": "network-vif-plugged", "status": "completed", "tag": "aef9925c-8048-4095-a618-0d55f10b32a1"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:57:19.582989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:57:19.582989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:57:19.593531 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-3450e732-6104-4c19-9939-444c8a937153 req-81470a9a-0d5d-48b3-82b6-7fbff29d002b service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:19.594034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-3450e732-6104-4c19-9939-444c8a937153 req-81470a9a-0d5d-48b3-82b6-7fbff29d002b service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:19.614477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-3450e732-6104-4c19-9939-444c8a937153 req-81470a9a-0d5d-48b3-82b6-7fbff29d002b service nova] Creating event network-vif-plugged:aef9925c-8048-4095-a618-0d55f10b32a1 for instance 4a606efe-c285-436f-9d27-d09708bc4564 on hv-cinder-73362 Apr 16 16:57:19.619707 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-3450e732-6104-4c19-9939-444c8a937153 req-81470a9a-0d5d-48b3-82b6-7fbff29d002b service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045781 Apr 16 16:57:19.620736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 510/1007] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:57:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:57:20.186342 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b9d4f1a2-9618-4ae8-8715-c421537a2123 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:20.187025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b9d4f1a2-9618-4ae8-8715-c421537a2123 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:20.196518 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9d4f1a2-9618-4ae8-8715-c421537a2123 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:20.197521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9d4f1a2-9618-4ae8-8715-c421537a2123 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:20.198700 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9d4f1a2-9618-4ae8-8715-c421537a2123 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:20.199392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9d4f1a2-9618-4ae8-8715-c421537a2123 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:20.455379 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b9d4f1a2-9618-4ae8-8715-c421537a2123 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:20.465922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b9d4f1a2-9618-4ae8-8715-c421537a2123 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:20.469073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-b9d4f1a2-9618-4ae8-8715-c421537a2123 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:20.470468 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b9d4f1a2-9618-4ae8-8715-c421537a2123 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.289410 Apr 16 16:57:20.471239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 498/1008] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:20 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:21.493662 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-aed8d824-4f10-4b71-b935-78beef2e42bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:21.499751 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-aed8d824-4f10-4b71-b935-78beef2e42bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:21.516311 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aed8d824-4f10-4b71-b935-78beef2e42bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:21.517164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aed8d824-4f10-4b71-b935-78beef2e42bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:21.518699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aed8d824-4f10-4b71-b935-78beef2e42bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:21.521228 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-aed8d824-4f10-4b71-b935-78beef2e42bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:21.832017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-aed8d824-4f10-4b71-b935-78beef2e42bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:21.848345 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-aed8d824-4f10-4b71-b935-78beef2e42bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:21.851607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-aed8d824-4f10-4b71-b935-78beef2e42bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:21.853644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-aed8d824-4f10-4b71-b935-78beef2e42bf tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1735 microversion: 2.20 time: 0.366230 Apr 16 16:57:21.857834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 511/1009] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:21 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1735 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:22.344889 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a9274d71-662f-438b-94ce-363757e5e2b6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:22.346256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a9274d71-662f-438b-94ce-363757e5e2b6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:22.357766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a9274d71-662f-438b-94ce-363757e5e2b6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:22.359113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a9274d71-662f-438b-94ce-363757e5e2b6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:22.360157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a9274d71-662f-438b-94ce-363757e5e2b6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:22.360648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a9274d71-662f-438b-94ce-363757e5e2b6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:22.437424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a9274d71-662f-438b-94ce-363757e5e2b6 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097289 Apr 16 16:57:22.438576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 499/1010] 10.222.0.103 () {58 vars in 1297 bytes} [Fri Apr 16 16:57:22 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:57:22.448992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6afec3da-e16f-4999-b3d5-18c25aa9d558 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:22.449542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6afec3da-e16f-4999-b3d5-18c25aa9d558 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:22.458647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6afec3da-e16f-4999-b3d5-18c25aa9d558 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:22.459163 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6afec3da-e16f-4999-b3d5-18c25aa9d558 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:22.460020 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6afec3da-e16f-4999-b3d5-18c25aa9d558 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:22.460514 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6afec3da-e16f-4999-b3d5-18c25aa9d558 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:22.530950 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6afec3da-e16f-4999-b3d5-18c25aa9d558 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments/967a20f8-7aa8-4b16-9bab-5fd64f4429e3" status: 200 len: 194 microversion: 2.1 time: 0.085999 Apr 16 16:57:22.531584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 512/1011] 10.222.0.103 () {58 vars in 1408 bytes} [Fri Apr 16 16:57:22 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments/967a20f8-7aa8-4b16-9bab-5fd64f4429e3 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:57:22.896887 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4fcb6640-4741-42a9-8968-06e2a91caba6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:22.898474 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4fcb6640-4741-42a9-8968-06e2a91caba6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:22.921691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4fcb6640-4741-42a9-8968-06e2a91caba6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:22.922201 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4fcb6640-4741-42a9-8968-06e2a91caba6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:22.929997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4fcb6640-4741-42a9-8968-06e2a91caba6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:22.930858 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4fcb6640-4741-42a9-8968-06e2a91caba6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:23.234896 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4fcb6640-4741-42a9-8968-06e2a91caba6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:23.244622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4fcb6640-4741-42a9-8968-06e2a91caba6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:23.246356 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4fcb6640-4741-42a9-8968-06e2a91caba6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:23.248165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4fcb6640-4741-42a9-8968-06e2a91caba6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1722 microversion: 2.20 time: 0.377281 Apr 16 16:57:23.249308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 500/1012] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:22 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1722 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:24.213758 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d78d27cf-910e-4dc7-bab2-4a4c6892d6b1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6d0379f-6a48-4f31-a74c-352d967b4ed5"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:57:24.215033 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d78d27cf-910e-4dc7-bab2-4a4c6892d6b1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:24.224712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d78d27cf-910e-4dc7-bab2-4a4c6892d6b1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:24.225309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d78d27cf-910e-4dc7-bab2-4a4c6892d6b1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:24.226109 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d78d27cf-910e-4dc7-bab2-4a4c6892d6b1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:24.226580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d78d27cf-910e-4dc7-bab2-4a4c6892d6b1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:24.710582 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d78d27cf-910e-4dc7-bab2-4a4c6892d6b1 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500957 Apr 16 16:57:24.711634 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 513/1013] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:57:24 2021] POST /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:57:32.835915 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-67fedc10-e1fb-4b3d-9a1f-32031fe588b5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:32.839563 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-67fedc10-e1fb-4b3d-9a1f-32031fe588b5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:32.849819 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-67fedc10-e1fb-4b3d-9a1f-32031fe588b5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:32.850213 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-67fedc10-e1fb-4b3d-9a1f-32031fe588b5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:32.851390 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-67fedc10-e1fb-4b3d-9a1f-32031fe588b5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:32.851898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-67fedc10-e1fb-4b3d-9a1f-32031fe588b5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:32.932369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-67fedc10-e1fb-4b3d-9a1f-32031fe588b5 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.102103 Apr 16 16:57:32.933053 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 501/1014] 10.222.0.103 () {58 vars in 1297 bytes} [Fri Apr 16 16:57:32 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:57:33.166036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-10a98e7b-8b65-4f84-b542-b7a925a61ebd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:33.167747 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-10a98e7b-8b65-4f84-b542-b7a925a61ebd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:33.183553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10a98e7b-8b65-4f84-b542-b7a925a61ebd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:33.184313 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10a98e7b-8b65-4f84-b542-b7a925a61ebd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:33.186308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10a98e7b-8b65-4f84-b542-b7a925a61ebd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:33.187176 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10a98e7b-8b65-4f84-b542-b7a925a61ebd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:33.285760 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-10a98e7b-8b65-4f84-b542-b7a925a61ebd tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments/967a20f8-7aa8-4b16-9bab-5fd64f4429e3" status: 200 len: 194 microversion: 2.1 time: 0.127597 Apr 16 16:57:33.286503 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 514/1015] 10.222.0.103 () {58 vars in 1408 bytes} [Fri Apr 16 16:57:33 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments/967a20f8-7aa8-4b16-9bab-5fd64f4429e3 => generated 194 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:57:33.301363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-20e1f2ac-96e6-41bb-b813-e06d50ec240a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:33.302154 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-20e1f2ac-96e6-41bb-b813-e06d50ec240a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:33.313422 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20e1f2ac-96e6-41bb-b813-e06d50ec240a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:33.314241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20e1f2ac-96e6-41bb-b813-e06d50ec240a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:33.315333 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20e1f2ac-96e6-41bb-b813-e06d50ec240a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:33.316059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-20e1f2ac-96e6-41bb-b813-e06d50ec240a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:33.596764 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-20e1f2ac-96e6-41bb-b813-e06d50ec240a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lazy-loading 'services' on Instance uuid eb2a15c6-8601-4a70-9281-a1259a155c9e {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:57:33.636644 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e0857ae9-6a4d-44d8-9a2e-42bda238dad8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:33.638826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e0857ae9-6a4d-44d8-9a2e-42bda238dad8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:33.654798 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e0857ae9-6a4d-44d8-9a2e-42bda238dad8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:33.656017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e0857ae9-6a4d-44d8-9a2e-42bda238dad8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:33.657790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e0857ae9-6a4d-44d8-9a2e-42bda238dad8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:33.658922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e0857ae9-6a4d-44d8-9a2e-42bda238dad8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:33.773239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e0857ae9-6a4d-44d8-9a2e-42bda238dad8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:57:33.824768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-20e1f2ac-96e6-41bb-b813-e06d50ec240a tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "DELETE /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments/967a20f8-7aa8-4b16-9bab-5fd64f4429e3" status: 202 len: 0 microversion: 2.1 time: 0.527224 Apr 16 16:57:33.828218 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 502/1016] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 16:57:33 2021] DELETE /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments/967a20f8-7aa8-4b16-9bab-5fd64f4429e3 => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:57:33.835133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-76edfaa6-2208-4627-aa0e-cd3b9465c9fd req-9ddfab0c-0a1f-461b-b399-05395ab1e4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5", "tag": "ee6c6c28-4fef-436e-a001-4f66a8ffef9d"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:57:33.839553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:57:33.839553 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:57:33.854171 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-76edfaa6-2208-4627-aa0e-cd3b9465c9fd req-9ddfab0c-0a1f-461b-b399-05395ab1e4f3 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:33.855120 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-76edfaa6-2208-4627-aa0e-cd3b9465c9fd req-9ddfab0c-0a1f-461b-b399-05395ab1e4f3 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:33.883688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-76edfaa6-2208-4627-aa0e-cd3b9465c9fd req-9ddfab0c-0a1f-461b-b399-05395ab1e4f3 service nova] Creating event network-changed:ee6c6c28-4fef-436e-a001-4f66a8ffef9d for instance e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 on hv-cinder-73362 Apr 16 16:57:33.891820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-76edfaa6-2208-4627-aa0e-cd3b9465c9fd req-9ddfab0c-0a1f-461b-b399-05395ab1e4f3 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061231 Apr 16 16:57:33.893185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 503/1017] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:57:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:57:34.029396 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e0857ae9-6a4d-44d8-9a2e-42bda238dad8 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "DELETE /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 204 len: 0 microversion: 2.1 time: 0.400301 Apr 16 16:57:34.029965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 515/1018] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:57:33 2021] DELETE /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:57:34.040031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dd8fa41f-6ce7-40cd-a1fe-d5fc38c80918 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:34.041237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dd8fa41f-6ce7-40cd-a1fe-d5fc38c80918 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:34.061297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dd8fa41f-6ce7-40cd-a1fe-d5fc38c80918 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:34.061823 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dd8fa41f-6ce7-40cd-a1fe-d5fc38c80918 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:34.062929 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dd8fa41f-6ce7-40cd-a1fe-d5fc38c80918 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:34.065620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dd8fa41f-6ce7-40cd-a1fe-d5fc38c80918 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:34.518477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-dd8fa41f-6ce7-40cd-a1fe-d5fc38c80918 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:34.538913 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dd8fa41f-6ce7-40cd-a1fe-d5fc38c80918 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1570 microversion: 2.1 time: 0.503114 Apr 16 16:57:34.539945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 504/1019] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:34 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1570 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:35.380087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-89deebc5-80bd-437d-a697-cbff5c47c69e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:35.380814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-89deebc5-80bd-437d-a697-cbff5c47c69e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:35.392325 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89deebc5-80bd-437d-a697-cbff5c47c69e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:35.392641 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89deebc5-80bd-437d-a697-cbff5c47c69e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:35.393522 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89deebc5-80bd-437d-a697-cbff5c47c69e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:35.394013 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89deebc5-80bd-437d-a697-cbff5c47c69e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:35.488092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-89deebc5-80bd-437d-a697-cbff5c47c69e tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments/b6d0379f-6a48-4f31-a74c-352d967b4ed5" status: 200 len: 194 microversion: 2.1 time: 0.113690 Apr 16 16:57:35.489118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 516/1020] 10.222.0.103 () {58 vars in 1408 bytes} [Fri Apr 16 16:57:35 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments/b6d0379f-6a48-4f31-a74c-352d967b4ed5 => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:57:35.517244 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7903302b-09f3-4903-a896-173bbd3b6ced tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:35.517810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7903302b-09f3-4903-a896-173bbd3b6ced tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:35.528354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7903302b-09f3-4903-a896-173bbd3b6ced tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:35.530023 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7903302b-09f3-4903-a896-173bbd3b6ced tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:35.530968 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7903302b-09f3-4903-a896-173bbd3b6ced tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:35.531658 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7903302b-09f3-4903-a896-173bbd3b6ced tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:35.566657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-77d30f1e-4ea0-4cd3-bc40-bf8fca7d3839 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:35.567343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-77d30f1e-4ea0-4cd3-bc40-bf8fca7d3839 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:35.576299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77d30f1e-4ea0-4cd3-bc40-bf8fca7d3839 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:35.576812 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77d30f1e-4ea0-4cd3-bc40-bf8fca7d3839 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:35.577670 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77d30f1e-4ea0-4cd3-bc40-bf8fca7d3839 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:35.578164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-77d30f1e-4ea0-4cd3-bc40-bf8fca7d3839 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:35.737807 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-7903302b-09f3-4903-a896-173bbd3b6ced tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lazy-loading 'services' on Instance uuid eb2a15c6-8601-4a70-9281-a1259a155c9e {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:57:35.829411 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-77d30f1e-4ea0-4cd3-bc40-bf8fca7d3839 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:35.840200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-77d30f1e-4ea0-4cd3-bc40-bf8fca7d3839 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1451 microversion: 2.1 time: 0.277632 Apr 16 16:57:35.840846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 517/1021] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:35 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1451 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:57:35.891479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7903302b-09f3-4903-a896-173bbd3b6ced tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "DELETE /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments/b6d0379f-6a48-4f31-a74c-352d967b4ed5" status: 202 len: 0 microversion: 2.1 time: 0.394832 Apr 16 16:57:35.892495 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 505/1022] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 16:57:35 2021] DELETE /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e/os-volume_attachments/b6d0379f-6a48-4f31-a74c-352d967b4ed5 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:57:36.860265 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-725aec8d-e2a8-4dad-9279-c878f995da42 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:36.861058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-725aec8d-e2a8-4dad-9279-c878f995da42 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:36.873573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-725aec8d-e2a8-4dad-9279-c878f995da42 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:36.874104 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-725aec8d-e2a8-4dad-9279-c878f995da42 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:36.875055 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-725aec8d-e2a8-4dad-9279-c878f995da42 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:36.875551 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-725aec8d-e2a8-4dad-9279-c878f995da42 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:37.040722 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-725aec8d-e2a8-4dad-9279-c878f995da42 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:37.055143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-725aec8d-e2a8-4dad-9279-c878f995da42 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1385 microversion: 2.1 time: 0.199120 Apr 16 16:57:37.056004 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 518/1023] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:36 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1385 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:57:37.274586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-669ba9da-1538-4372-806f-cd553737633c req-103e4edd-3523-4444-9fa1-9b5176d3f3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5", "name": "network-vif-deleted", "tag": "ee6c6c28-4fef-436e-a001-4f66a8ffef9d"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:57:37.276684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:57:37.276684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:57:37.288271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-669ba9da-1538-4372-806f-cd553737633c req-103e4edd-3523-4444-9fa1-9b5176d3f3f7 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:37.288271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-669ba9da-1538-4372-806f-cd553737633c req-103e4edd-3523-4444-9fa1-9b5176d3f3f7 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:37.314249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-669ba9da-1538-4372-806f-cd553737633c req-103e4edd-3523-4444-9fa1-9b5176d3f3f7 service nova] Creating event network-vif-deleted:ee6c6c28-4fef-436e-a001-4f66a8ffef9d for instance e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 on hv-cinder-73362 Apr 16 16:57:37.319299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-669ba9da-1538-4372-806f-cd553737633c req-103e4edd-3523-4444-9fa1-9b5176d3f3f7 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050198 Apr 16 16:57:37.320140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 506/1024] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:57:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:57:37.620358 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-be48ae30-75f3-4ed4-95c5-f891363ca3a3 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:37.620916 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-be48ae30-75f3-4ed4-95c5-f891363ca3a3 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:37.629661 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be48ae30-75f3-4ed4-95c5-f891363ca3a3 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:37.630172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be48ae30-75f3-4ed4-95c5-f891363ca3a3 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:37.631093 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be48ae30-75f3-4ed4-95c5-f891363ca3a3 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:37.632125 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-be48ae30-75f3-4ed4-95c5-f891363ca3a3 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:37.718247 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-be48ae30-75f3-4ed4-95c5-f891363ca3a3 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:57:37.855907 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-be48ae30-75f3-4ed4-95c5-f891363ca3a3 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "DELETE /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 204 len: 0 microversion: 2.1 time: 0.239014 Apr 16 16:57:37.856999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 519/1025] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:57:37 2021] DELETE /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 16:57:37.869056 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-34101fbb-675e-4f96-8425-9d9b2393cbad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:37.870464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-34101fbb-675e-4f96-8425-9d9b2393cbad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:37.878957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34101fbb-675e-4f96-8425-9d9b2393cbad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:37.879456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34101fbb-675e-4f96-8425-9d9b2393cbad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:37.880300 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34101fbb-675e-4f96-8425-9d9b2393cbad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:37.880805 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34101fbb-675e-4f96-8425-9d9b2393cbad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:38.077697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:38.078810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:38.089696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:38.090317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:38.091453 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:38.092062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:38.120612 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-34101fbb-675e-4f96-8425-9d9b2393cbad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:38.133256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-34101fbb-675e-4f96-8425-9d9b2393cbad tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1680 microversion: 2.1 time: 0.270410 Apr 16 16:57:38.134343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 507/1026] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:37 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1680 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:57:38.182931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:38.183450 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:38.183960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lazy-loading 'fault' on Instance uuid e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:57:38.255606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '095c903e1e3747aa8c7201ca585aef54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e2bc75e4e1400fab18b3944402fa76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:38.267535 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d3c9b5e0-2c72-4193-aa98-0085cde5b37b tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 200 len: 1226 microversion: 2.1 time: 0.197148 Apr 16 16:57:38.269049 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 520/1027] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:38 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 1226 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 16:57:39.153783 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-96edebc3-e9f5-40f5-a1f3-c0d854fdfeee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:39.154470 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-96edebc3-e9f5-40f5-a1f3-c0d854fdfeee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:39.162381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-96edebc3-e9f5-40f5-a1f3-c0d854fdfeee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:39.162893 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-96edebc3-e9f5-40f5-a1f3-c0d854fdfeee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:39.163737 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-96edebc3-e9f5-40f5-a1f3-c0d854fdfeee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:39.164231 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-96edebc3-e9f5-40f5-a1f3-c0d854fdfeee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:39.287793 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c2867daa-fdde-4501-8250-06356b8b2516 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:39.288627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c2867daa-fdde-4501-8250-06356b8b2516 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] [instance: e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:39.298820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2867daa-fdde-4501-8250-06356b8b2516 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:39.299338 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2867daa-fdde-4501-8250-06356b8b2516 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:39.300200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2867daa-fdde-4501-8250-06356b8b2516 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:39.300710 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2867daa-fdde-4501-8250-06356b8b2516 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:39.355027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-c2867daa-fdde-4501-8250-06356b8b2516 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] HTTP exception thrown: Instance e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 could not be found. Apr 16 16:57:39.355699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c2867daa-fdde-4501-8250-06356b8b2516 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Returning 404 to user: Instance e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:57:39.357114 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c2867daa-fdde-4501-8250-06356b8b2516 tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5" status: 404 len: 111 microversion: 2.1 time: 0.073390 Apr 16 16:57:39.357918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 521/1028] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:39 2021] GET /compute/v2.1/servers/e8d58e0b-9875-4b16-a7f5-329f4ce3b7d5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:57:39.395489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-96edebc3-e9f5-40f5-a1f3-c0d854fdfeee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:39.405301 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-96edebc3-e9f5-40f5-a1f3-c0d854fdfeee tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1680 microversion: 2.1 time: 0.255602 Apr 16 16:57:39.405944 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 508/1029] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:39 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:39.583532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3517a58d-5765-4d0b-8338-4e483ddc91ff tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] Calling method '.version_select at 0x7f0d4462cbf8>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:39.602460 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3517a58d-5765-4d0b-8338-4e483ddc91ff tempest-TestShelveInstance-1374508426 tempest-TestShelveInstance-1374508426-project] 10.222.0.103 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-198386243" status: 202 len: 0 microversion: 2.1 time: 0.022956 Apr 16 16:57:39.603627 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 522/1030] 10.222.0.103 () {58 vars in 1246 bytes} [Fri Apr 16 16:57:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-198386243 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:57:40.424335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-34884ffa-03a7-4701-8dd0-64d9e76bd453 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:40.425007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-34884ffa-03a7-4701-8dd0-64d9e76bd453 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:40.433234 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34884ffa-03a7-4701-8dd0-64d9e76bd453 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:40.433746 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34884ffa-03a7-4701-8dd0-64d9e76bd453 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:40.435186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34884ffa-03a7-4701-8dd0-64d9e76bd453 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:40.435846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-34884ffa-03a7-4701-8dd0-64d9e76bd453 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:40.674216 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-34884ffa-03a7-4701-8dd0-64d9e76bd453 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:40.683669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-34884ffa-03a7-4701-8dd0-64d9e76bd453 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1680 microversion: 2.1 time: 0.263616 Apr 16 16:57:40.684299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 509/1031] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:40 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1680 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:41.703277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0efd36ca-c7c2-4987-b205-6f24a1c68551 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:41.703938 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0efd36ca-c7c2-4987-b205-6f24a1c68551 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:41.715736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0efd36ca-c7c2-4987-b205-6f24a1c68551 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:41.716917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0efd36ca-c7c2-4987-b205-6f24a1c68551 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:41.717761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0efd36ca-c7c2-4987-b205-6f24a1c68551 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:41.718248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0efd36ca-c7c2-4987-b205-6f24a1c68551 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:41.943305 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0efd36ca-c7c2-4987-b205-6f24a1c68551 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:41.952882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0efd36ca-c7c2-4987-b205-6f24a1c68551 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1680 microversion: 2.1 time: 0.254369 Apr 16 16:57:41.953514 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 523/1032] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:41 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:42.971965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ce4975e3-b4ad-48bb-aa73-8e910e70debb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:42.972750 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ce4975e3-b4ad-48bb-aa73-8e910e70debb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:42.981089 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce4975e3-b4ad-48bb-aa73-8e910e70debb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:42.982182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce4975e3-b4ad-48bb-aa73-8e910e70debb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:42.983294 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce4975e3-b4ad-48bb-aa73-8e910e70debb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:42.983856 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ce4975e3-b4ad-48bb-aa73-8e910e70debb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:43.125207 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-ce4975e3-b4ad-48bb-aa73-8e910e70debb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e7f3d7b43748658c69c338db617181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fb0e15979d43999b94901003579a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:43.135096 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ce4975e3-b4ad-48bb-aa73-8e910e70debb tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 200 len: 1612 microversion: 2.1 time: 0.167253 Apr 16 16:57:43.135991 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 510/1033] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:42 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 1612 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:57:43.235544 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-ccd34a83-9bf9-4161-a4b6-ff23cf8c2bfa req-9e32d4cd-664b-4f70-be05-f946924ad273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb2a15c6-8601-4a70-9281-a1259a155c9e", "name": "network-vif-deleted", "tag": "5b904929-85e9-4626-bc83-c45200f69e9a"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:57:43.237266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:57:43.237266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:57:43.246673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-ccd34a83-9bf9-4161-a4b6-ff23cf8c2bfa req-9e32d4cd-664b-4f70-be05-f946924ad273 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:43.248249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-ccd34a83-9bf9-4161-a4b6-ff23cf8c2bfa req-9e32d4cd-664b-4f70-be05-f946924ad273 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:43.269248 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-ccd34a83-9bf9-4161-a4b6-ff23cf8c2bfa req-9e32d4cd-664b-4f70-be05-f946924ad273 service nova] Creating event network-vif-deleted:5b904929-85e9-4626-bc83-c45200f69e9a for instance eb2a15c6-8601-4a70-9281-a1259a155c9e on hv-cinder-73362 Apr 16 16:57:43.275385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-ccd34a83-9bf9-4161-a4b6-ff23cf8c2bfa req-9e32d4cd-664b-4f70-be05-f946924ad273 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044335 Apr 16 16:57:43.276029 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 524/1034] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:57:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:57:44.154082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ed5cd734-c54d-4aa4-aab4-13aaa6f8acb9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:44.155631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-ed5cd734-c54d-4aa4-aab4-13aaa6f8acb9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:44.164363 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed5cd734-c54d-4aa4-aab4-13aaa6f8acb9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:44.165831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed5cd734-c54d-4aa4-aab4-13aaa6f8acb9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:44.166994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed5cd734-c54d-4aa4-aab4-13aaa6f8acb9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:44.167689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-ed5cd734-c54d-4aa4-aab4-13aaa6f8acb9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:44.227307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-ed5cd734-c54d-4aa4-aab4-13aaa6f8acb9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] HTTP exception thrown: Instance eb2a15c6-8601-4a70-9281-a1259a155c9e could not be found. Apr 16 16:57:44.228268 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ed5cd734-c54d-4aa4-aab4-13aaa6f8acb9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Returning 404 to user: Instance eb2a15c6-8601-4a70-9281-a1259a155c9e could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:57:44.229282 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ed5cd734-c54d-4aa4-aab4-13aaa6f8acb9 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 404 len: 111 microversion: 2.1 time: 0.079727 Apr 16 16:57:44.230065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 511/1035] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:44 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:57:44.240541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-58d4e063-b81d-4aac-8405-b16875f32449 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '.version_select at 0x7f0d446c4510>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:44.258604 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-58d4e063-b81d-4aac-8405-b16875f32449 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237762689" status: 202 len: 0 microversion: 2.1 time: 0.022434 Apr 16 16:57:44.259537 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 525/1036] 10.222.0.103 () {58 vars in 1216 bytes} [Fri Apr 16 16:57:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237762689 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 16:57:49.350239 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d7b841d1-70f0-448c-8b21-f27a512ecb00 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:49.350838 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d7b841d1-70f0-448c-8b21-f27a512ecb00 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:49.359497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d7b841d1-70f0-448c-8b21-f27a512ecb00 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:49.359986 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d7b841d1-70f0-448c-8b21-f27a512ecb00 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:49.361071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d7b841d1-70f0-448c-8b21-f27a512ecb00 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:49.361567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d7b841d1-70f0-448c-8b21-f27a512ecb00 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:49.424641 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-d7b841d1-70f0-448c-8b21-f27a512ecb00 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] HTTP exception thrown: Instance eb2a15c6-8601-4a70-9281-a1259a155c9e could not be found. Apr 16 16:57:49.425321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d7b841d1-70f0-448c-8b21-f27a512ecb00 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Returning 404 to user: Instance eb2a15c6-8601-4a70-9281-a1259a155c9e could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:57:49.426210 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d7b841d1-70f0-448c-8b21-f27a512ecb00 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "DELETE /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 404 len: 111 microversion: 2.1 time: 0.080376 Apr 16 16:57:49.426872 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 512/1037] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:57:49 2021] DELETE /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:57:49.437352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-257ae15d-907c-43c9-b76d-cb492d8484be tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:49.438177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-257ae15d-907c-43c9-b76d-cb492d8484be tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: eb2a15c6-8601-4a70-9281-a1259a155c9e] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:49.447697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-257ae15d-907c-43c9-b76d-cb492d8484be tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:49.448209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-257ae15d-907c-43c9-b76d-cb492d8484be tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:49.449087 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-257ae15d-907c-43c9-b76d-cb492d8484be tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:49.449583 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-257ae15d-907c-43c9-b76d-cb492d8484be tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:49.510778 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-257ae15d-907c-43c9-b76d-cb492d8484be tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] HTTP exception thrown: Instance eb2a15c6-8601-4a70-9281-a1259a155c9e could not be found. Apr 16 16:57:49.511740 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-257ae15d-907c-43c9-b76d-cb492d8484be tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Returning 404 to user: Instance eb2a15c6-8601-4a70-9281-a1259a155c9e could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:57:49.513246 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-257ae15d-907c-43c9-b76d-cb492d8484be tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e" status: 404 len: 111 microversion: 2.1 time: 0.080761 Apr 16 16:57:49.514685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 526/1038] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:49 2021] GET /compute/v2.1/servers/eb2a15c6-8601-4a70-9281-a1259a155c9e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 16:57:50.782036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dcfbfab3-705b-4c46-be3b-98d3301ce496 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:50.782688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dcfbfab3-705b-4c46-be3b-98d3301ce496 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:50.801183 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dcfbfab3-705b-4c46-be3b-98d3301ce496 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:50.801694 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dcfbfab3-705b-4c46-be3b-98d3301ce496 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:50.802571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dcfbfab3-705b-4c46-be3b-98d3301ce496 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:50.803182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dcfbfab3-705b-4c46-be3b-98d3301ce496 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:50.865312 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-dcfbfab3-705b-4c46-be3b-98d3301ce496 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] HTTP exception thrown: Instance 22e97f89-9724-46b1-8d71-56732a4b3c27 could not be found. Apr 16 16:57:50.865979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dcfbfab3-705b-4c46-be3b-98d3301ce496 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Returning 404 to user: Instance 22e97f89-9724-46b1-8d71-56732a4b3c27 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:57:50.866940 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dcfbfab3-705b-4c46-be3b-98d3301ce496 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "DELETE /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 404 len: 111 microversion: 2.1 time: 0.089944 Apr 16 16:57:50.867672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 513/1039] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:57:50 2021] DELETE /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:57:50.876640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b9b89c41-77cc-4740-b6f6-bb2731c2b494 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:50.877308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-b9b89c41-77cc-4740-b6f6-bb2731c2b494 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] [instance: 22e97f89-9724-46b1-8d71-56732a4b3c27] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:50.885442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9b89c41-77cc-4740-b6f6-bb2731c2b494 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:50.886060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9b89c41-77cc-4740-b6f6-bb2731c2b494 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:50.887165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9b89c41-77cc-4740-b6f6-bb2731c2b494 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:50.888234 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-b9b89c41-77cc-4740-b6f6-bb2731c2b494 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:50.943110 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-b9b89c41-77cc-4740-b6f6-bb2731c2b494 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] HTTP exception thrown: Instance 22e97f89-9724-46b1-8d71-56732a4b3c27 could not be found. Apr 16 16:57:50.943788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b9b89c41-77cc-4740-b6f6-bb2731c2b494 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] Returning 404 to user: Instance 22e97f89-9724-46b1-8d71-56732a4b3c27 could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:57:50.944691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b9b89c41-77cc-4740-b6f6-bb2731c2b494 tempest-AttachVolumeTestJSON-1968708646 tempest-AttachVolumeTestJSON-1968708646-project] 10.222.0.103 "GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27" status: 404 len: 111 microversion: 2.1 time: 0.072423 Apr 16 16:57:50.945317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 527/1040] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:57:50 2021] GET /compute/v2.1/servers/22e97f89-9724-46b1-8d71-56732a4b3c27 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:57:56.946068 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a6d8842d-ccc8-4193-9164-a09f75cc4879 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:56.946712 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a6d8842d-ccc8-4193-9164-a09f75cc4879 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:56.960546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6d8842d-ccc8-4193-9164-a09f75cc4879 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:56.961035 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6d8842d-ccc8-4193-9164-a09f75cc4879 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:56.963433 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6d8842d-ccc8-4193-9164-a09f75cc4879 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:56.964128 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6d8842d-ccc8-4193-9164-a09f75cc4879 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:57.046735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a6d8842d-ccc8-4193-9164-a09f75cc4879 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Going to try to terminate instance {{(pid=99399) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 16:57:57.221147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a6d8842d-ccc8-4193-9164-a09f75cc4879 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "DELETE /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 204 len: 0 microversion: 2.20 time: 0.279559 Apr 16 16:57:57.222156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 514/1041] 10.222.0.103 () {60 vars in 1275 bytes} [Fri Apr 16 16:57:56 2021] DELETE /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 16:57:57.232513 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-55f9cb8a-d166-4051-8749-747ecae5811c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:57.233298 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-55f9cb8a-d166-4051-8749-747ecae5811c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:57.248544 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-55f9cb8a-d166-4051-8749-747ecae5811c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:57.252672 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-55f9cb8a-d166-4051-8749-747ecae5811c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:57.253606 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-55f9cb8a-d166-4051-8749-747ecae5811c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:57.254111 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-55f9cb8a-d166-4051-8749-747ecae5811c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:57.616014 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-55f9cb8a-d166-4051-8749-747ecae5811c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:57.632118 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-55f9cb8a-d166-4051-8749-747ecae5811c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:57.635850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-55f9cb8a-d166-4051-8749-747ecae5811c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:57.639091 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-55f9cb8a-d166-4051-8749-747ecae5811c tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.411052 Apr 16 16:57:57.640158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 528/1042] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:57 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:57:58.682168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f6af1112-859d-4dc4-b6f2-72f391d03982 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:57:58.685559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f6af1112-859d-4dc4-b6f2-72f391d03982 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:57:58.703835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6af1112-859d-4dc4-b6f2-72f391d03982 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:58.704733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6af1112-859d-4dc4-b6f2-72f391d03982 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:58.706540 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6af1112-859d-4dc4-b6f2-72f391d03982 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:57:58.707521 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6af1112-859d-4dc4-b6f2-72f391d03982 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:57:59.068484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f6af1112-859d-4dc4-b6f2-72f391d03982 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:59.084469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f6af1112-859d-4dc4-b6f2-72f391d03982 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:59.087037 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f6af1112-859d-4dc4-b6f2-72f391d03982 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:57:59.089352 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f6af1112-859d-4dc4-b6f2-72f391d03982 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.416875 Apr 16 16:57:59.090334 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 515/1043] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:57:58 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:58:00.114141 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d601154c-b0e5-4b72-8b27-52821938ddb6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:00.115609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d601154c-b0e5-4b72-8b27-52821938ddb6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:00.125437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d601154c-b0e5-4b72-8b27-52821938ddb6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:00.125955 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d601154c-b0e5-4b72-8b27-52821938ddb6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:00.126850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d601154c-b0e5-4b72-8b27-52821938ddb6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:00.127365 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d601154c-b0e5-4b72-8b27-52821938ddb6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:00.423051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d601154c-b0e5-4b72-8b27-52821938ddb6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:00.438385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d601154c-b0e5-4b72-8b27-52821938ddb6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:00.440282 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d601154c-b0e5-4b72-8b27-52821938ddb6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:00.442102 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d601154c-b0e5-4b72-8b27-52821938ddb6 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1728 microversion: 2.20 time: 0.332316 Apr 16 16:58:00.442743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 529/1044] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:58:00 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1728 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:58:01.463786 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-702c1551-b270-4880-acd7-07bb151f0180 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:01.465038 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-702c1551-b270-4880-acd7-07bb151f0180 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:01.494017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-702c1551-b270-4880-acd7-07bb151f0180 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:01.494831 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-702c1551-b270-4880-acd7-07bb151f0180 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:01.495890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-702c1551-b270-4880-acd7-07bb151f0180 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:01.496567 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-702c1551-b270-4880-acd7-07bb151f0180 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:01.681546 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-702c1551-b270-4880-acd7-07bb151f0180 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:01.693456 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-702c1551-b270-4880-acd7-07bb151f0180 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:01.702347 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-702c1551-b270-4880-acd7-07bb151f0180 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:01.704167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-702c1551-b270-4880-acd7-07bb151f0180 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1660 microversion: 2.20 time: 0.244475 Apr 16 16:58:01.705032 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 516/1045] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:58:01 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1660 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:58:02.574688 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-3367368a-0226-49bd-9c04-e357891ae161 req-d681c2eb-5dcb-4f84-bf1a-51fcd34d4f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a606efe-c285-436f-9d27-d09708bc4564", "name": "network-vif-deleted", "tag": "aef9925c-8048-4095-a618-0d55f10b32a1"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:58:02.577882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:58:02.577882 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:58:02.589380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-3367368a-0226-49bd-9c04-e357891ae161 req-d681c2eb-5dcb-4f84-bf1a-51fcd34d4f96 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:02.590245 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-3367368a-0226-49bd-9c04-e357891ae161 req-d681c2eb-5dcb-4f84-bf1a-51fcd34d4f96 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:02.623160 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-3367368a-0226-49bd-9c04-e357891ae161 req-d681c2eb-5dcb-4f84-bf1a-51fcd34d4f96 service nova] Creating event network-vif-deleted:aef9925c-8048-4095-a618-0d55f10b32a1 for instance 4a606efe-c285-436f-9d27-d09708bc4564 on hv-cinder-73362 Apr 16 16:58:02.632079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-3367368a-0226-49bd-9c04-e357891ae161 req-d681c2eb-5dcb-4f84-bf1a-51fcd34d4f96 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062301 Apr 16 16:58:02.633304 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 530/1046] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:58:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:02.726221 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:02.727377 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:02.739382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:02.740202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:02.741835 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:02.742664 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:02.833143 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:02.833821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:02.834392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lazy-loading 'fault' on Instance uuid 4a606efe-c285-436f-9d27-d09708bc4564 {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 16:58:02.911464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:02.922960 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:02.925009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60265b8ee174e36a604896147c47d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb882053c8e84304847e19528f11d911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:02.926693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f6f8409c-272e-4dd6-a45f-25acc5e99abd tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 200 len: 1375 microversion: 2.20 time: 0.205096 Apr 16 16:58:02.927542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 517/1047] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:58:02 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 1375 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 16:58:03.222584 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e9986c4b-6347-49c4-a6fb-27c0d0d35ae4 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Action: 'create', calling method: .version_select at 0x7f0d446c47b8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1338085618"}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:58:03.724912 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e9986c4b-6347-49c4-a6fb-27c0d0d35ae4 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.705213 Apr 16 16:58:03.725723 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 531/1048] 10.222.0.103 () {60 vars in 1150 bytes} [Fri Apr 16 16:58:03 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 707 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Apr 16 16:58:03.739637 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ca501114-27c9-440f-a3e7-d1a7efbc7c05 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d445741e0>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:03.870505 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ca501114-27c9-440f-a3e7-d1a7efbc7c05 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da" status: 200 len: 345 microversion: 2.1 time: 0.135067 Apr 16 16:58:03.871139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 518/1049] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:58:03 2021] GET /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:03.948385 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a6c394ee-2f0e-44f8-b2f8-8fff0844342f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:03.949182 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a6c394ee-2f0e-44f8-b2f8-8fff0844342f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:03.958868 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6c394ee-2f0e-44f8-b2f8-8fff0844342f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:03.959378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6c394ee-2f0e-44f8-b2f8-8fff0844342f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:03.960249 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6c394ee-2f0e-44f8-b2f8-8fff0844342f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:03.960754 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a6c394ee-2f0e-44f8-b2f8-8fff0844342f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:04.019034 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-a6c394ee-2f0e-44f8-b2f8-8fff0844342f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] HTTP exception thrown: Instance 4a606efe-c285-436f-9d27-d09708bc4564 could not be found. Apr 16 16:58:04.019726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a6c394ee-2f0e-44f8-b2f8-8fff0844342f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Returning 404 to user: Instance 4a606efe-c285-436f-9d27-d09708bc4564 could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:58:04.020635 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a6c394ee-2f0e-44f8-b2f8-8fff0844342f tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 404 len: 111 microversion: 2.20 time: 0.077694 Apr 16 16:58:04.021573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 532/1050] 10.222.0.103 () {60 vars in 1272 bytes} [Fri Apr 16 16:58:03 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 16:58:04.030743 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-848db597-b4d8-47c7-9420-fe25b23167ac tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '.version_select at 0x7f0d450f30d0>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:04.050638 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-848db597-b4d8-47c7-9420-fe25b23167ac tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-651552847" status: 204 len: 0 microversion: 2.20 time: 0.023956 Apr 16 16:58:04.051273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 519/1051] 10.222.0.103 () {60 vars in 1254 bytes} [Fri Apr 16 16:58:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-651552847 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 16:58:04.885318 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-59627548-798e-4f7e-bdd1-d20103a03430 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d46215e18>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:04.988225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-59627548-798e-4f7e-bdd1-d20103a03430 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da" status: 200 len: 346 microversion: 2.1 time: 0.107835 Apr 16 16:58:04.988873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 533/1052] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:58:04 2021] GET /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:05.000890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-b4404f86-5d9b-4572-ae81-52eb9521604f tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Action: 'create', calling method: .version_select at 0x7f0d459e5a60>, body: {"snapshot": {"volume_id": "dd5c5524-99f6-4da7-882b-354b9b9807da", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1502206950"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:58:05.266665 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-b4404f86-5d9b-4572-ae81-52eb9521604f tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.269798 Apr 16 16:58:05.267307 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 520/1053] 10.222.0.103 () {60 vars in 1157 bytes} [Fri Apr 16 16:58:04 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:05.278512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d3fc4643-31aa-47b6-b4f3-1af97a4bd281 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d462158c8>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:05.329068 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d3fc4643-31aa-47b6-b4f3-1af97a4bd281 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497" status: 200 len: 287 microversion: 2.1 time: 0.054715 Apr 16 16:58:05.330015 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 534/1054] 10.222.0.103 () {58 vars in 1246 bytes} [Fri Apr 16 16:58:05 2021] GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:05.342180 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2e1ba89d-aaad-4a4d-8eb3-a62eb06812ed tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d446e6158>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:05.388200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2e1ba89d-aaad-4a4d-8eb3-a62eb06812ed tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.051075 Apr 16 16:58:05.388824 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 521/1055] 10.222.0.103 () {58 vars in 1135 bytes} [Fri Apr 16 16:58:05 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:05.400242 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-1897ddaf-3832-435d-8124-1d346dcc90e7 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d4462cea0>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:05.454547 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-1897ddaf-3832-435d-8124-1d346dcc90e7 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497" status: 200 len: 287 microversion: 2.1 time: 0.058669 Apr 16 16:58:05.455166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 535/1056] 10.222.0.103 () {58 vars in 1246 bytes} [Fri Apr 16 16:58:05 2021] GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:06.470844 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-ce4705e8-f62f-4776-873e-2f3d5a162bff tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d459e5e18>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:06.530261 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-ce4705e8-f62f-4776-873e-2f3d5a162bff tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497" status: 200 len: 287 microversion: 2.1 time: 0.066203 Apr 16 16:58:06.531713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 522/1057] 10.222.0.103 () {58 vars in 1246 bytes} [Fri Apr 16 16:58:06 2021] GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:07.545468 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-15b49304-0484-4e56-8c94-b980e65253e3 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d46215e18>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:07.597484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-15b49304-0484-4e56-8c94-b980e65253e3 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497" status: 200 len: 287 microversion: 2.1 time: 0.056310 Apr 16 16:58:07.598737 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 536/1058] 10.222.0.103 () {58 vars in 1246 bytes} [Fri Apr 16 16:58:07 2021] GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:08.612060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e7ab215f-e329-4863-9fc7-e85b1c5c44a9 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d459e5d08>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:08.666421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e7ab215f-e329-4863-9fc7-e85b1c5c44a9 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497" status: 200 len: 288 microversion: 2.1 time: 0.058622 Apr 16 16:58:08.667053 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 523/1059] 10.222.0.103 () {58 vars in 1246 bytes} [Fri Apr 16 16:58:08 2021] GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497 => generated 288 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:58:08.679054 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7c58486c-9c36-4dd9-b2c8-3b7ac0864eca tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d499da2f0>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:08.747358 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2b428f53-1a1b-40b7-bab2-fd67eac1d71e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:08.747929 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2b428f53-1a1b-40b7-bab2-fd67eac1d71e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:08.756656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b428f53-1a1b-40b7-bab2-fd67eac1d71e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:08.757167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b428f53-1a1b-40b7-bab2-fd67eac1d71e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:08.758024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b428f53-1a1b-40b7-bab2-fd67eac1d71e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:08.758549 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2b428f53-1a1b-40b7-bab2-fd67eac1d71e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:08.814326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-2b428f53-1a1b-40b7-bab2-fd67eac1d71e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] HTTP exception thrown: Instance 4a606efe-c285-436f-9d27-d09708bc4564 could not be found. Apr 16 16:58:08.815167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2b428f53-1a1b-40b7-bab2-fd67eac1d71e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Returning 404 to user: Instance 4a606efe-c285-436f-9d27-d09708bc4564 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:58:08.816166 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2b428f53-1a1b-40b7-bab2-fd67eac1d71e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "DELETE /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 404 len: 111 microversion: 2.1 time: 0.073858 Apr 16 16:58:08.816848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 524/1060] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:58:08 2021] DELETE /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:58:08.826877 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-74d58818-34d6-4052-bf95-80252fa76330 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:08.827542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-74d58818-34d6-4052-bf95-80252fa76330 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: 4a606efe-c285-436f-9d27-d09708bc4564] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:08.837064 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74d58818-34d6-4052-bf95-80252fa76330 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:08.837299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7c58486c-9c36-4dd9-b2c8-3b7ac0864eca tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "DELETE /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497" status: 202 len: 0 microversion: 2.1 time: 0.162165 Apr 16 16:58:08.838177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74d58818-34d6-4052-bf95-80252fa76330 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:08.838383 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 537/1061] 10.222.0.103 () {58 vars in 1249 bytes} [Fri Apr 16 16:58:08 2021] DELETE /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:58:08.839208 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74d58818-34d6-4052-bf95-80252fa76330 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:08.839952 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-74d58818-34d6-4052-bf95-80252fa76330 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:08.851852 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e88c07d2-3f6c-4092-b690-1b0f636dcd20 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d4462c950>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:08.926808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e88c07d2-3f6c-4092-b690-1b0f636dcd20 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497" status: 200 len: 287 microversion: 2.1 time: 0.078889 Apr 16 16:58:08.927589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 538/1062] 10.222.0.103 () {58 vars in 1246 bytes} [Fri Apr 16 16:58:08 2021] GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 16:58:08.939072 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-74d58818-34d6-4052-bf95-80252fa76330 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] HTTP exception thrown: Instance 4a606efe-c285-436f-9d27-d09708bc4564 could not be found. Apr 16 16:58:08.939742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-74d58818-34d6-4052-bf95-80252fa76330 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Returning 404 to user: Instance 4a606efe-c285-436f-9d27-d09708bc4564 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:58:08.940646 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-74d58818-34d6-4052-bf95-80252fa76330 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564" status: 404 len: 111 microversion: 2.1 time: 0.119113 Apr 16 16:58:08.941258 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 525/1063] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:08 2021] GET /compute/v2.1/servers/4a606efe-c285-436f-9d27-d09708bc4564 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:58:09.943181 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a74b2eb5-2edc-4f89-bed5-327333961b9b tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d4462c0d0>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:09.985571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-a74b2eb5-2edc-4f89-bed5-327333961b9b tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] HTTP exception thrown: Snapshot 1260c6e0-cdc2-496e-b3c4-dcdc42adb497 could not be found. Apr 16 16:58:09.986478 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a74b2eb5-2edc-4f89-bed5-327333961b9b tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Returning 404 to user: Snapshot 1260c6e0-cdc2-496e-b3c4-dcdc42adb497 could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:58:09.987477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a74b2eb5-2edc-4f89-bed5-327333961b9b tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497" status: 404 len: 111 microversion: 2.1 time: 0.048486 Apr 16 16:58:09.988455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 539/1064] 10.222.0.103 () {58 vars in 1246 bytes} [Fri Apr 16 16:58:09 2021] GET /compute/v2.1/os-snapshots/1260c6e0-cdc2-496e-b3c4-dcdc42adb497 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:58:10.000580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a79a2bd9-5979-4459-9dc5-ec38d9f99b43 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d446737b8>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:10.097730 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a79a2bd9-5979-4459-9dc5-ec38d9f99b43 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "DELETE /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da" status: 202 len: 0 microversion: 2.1 time: 0.101892 Apr 16 16:58:10.098381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 526/1065] 10.222.0.103 () {58 vars in 1243 bytes} [Fri Apr 16 16:58:09 2021] DELETE /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 16:58:10.107579 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-346b54c6-a5ec-43f6-83ae-6d573014d6cd tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d4462ce18>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:10.209303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-346b54c6-a5ec-43f6-83ae-6d573014d6cd tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da" status: 200 len: 345 microversion: 2.1 time: 0.106061 Apr 16 16:58:10.210007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 540/1066] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:58:10 2021] GET /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:10.222708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-809ef32c-ae53-4011-8b7f-0e4a326b7e5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:10.223255 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-809ef32c-ae53-4011-8b7f-0e4a326b7e5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:10.231919 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-809ef32c-ae53-4011-8b7f-0e4a326b7e5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:10.232428 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-809ef32c-ae53-4011-8b7f-0e4a326b7e5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:10.233288 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-809ef32c-ae53-4011-8b7f-0e4a326b7e5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:10.233784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-809ef32c-ae53-4011-8b7f-0e4a326b7e5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:10.292089 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-809ef32c-ae53-4011-8b7f-0e4a326b7e5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] HTTP exception thrown: Instance bf021fce-d230-4117-992c-f91cd978276c could not be found. Apr 16 16:58:10.292765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-809ef32c-ae53-4011-8b7f-0e4a326b7e5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Returning 404 to user: Instance bf021fce-d230-4117-992c-f91cd978276c could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:58:10.293798 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-809ef32c-ae53-4011-8b7f-0e4a326b7e5e tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "DELETE /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 404 len: 111 microversion: 2.1 time: 0.075101 Apr 16 16:58:10.294429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 527/1067] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 16:58:10 2021] DELETE /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:58:10.303134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9c775433-7132-4b05-8d9d-b7e5a6f38980 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:10.303904 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9c775433-7132-4b05-8d9d-b7e5a6f38980 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] [instance: bf021fce-d230-4117-992c-f91cd978276c] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:10.314017 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9c775433-7132-4b05-8d9d-b7e5a6f38980 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:10.314569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9c775433-7132-4b05-8d9d-b7e5a6f38980 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:10.315409 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9c775433-7132-4b05-8d9d-b7e5a6f38980 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:10.315897 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9c775433-7132-4b05-8d9d-b7e5a6f38980 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:10.374408 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-9c775433-7132-4b05-8d9d-b7e5a6f38980 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] HTTP exception thrown: Instance bf021fce-d230-4117-992c-f91cd978276c could not be found. Apr 16 16:58:10.375076 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9c775433-7132-4b05-8d9d-b7e5a6f38980 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] Returning 404 to user: Instance bf021fce-d230-4117-992c-f91cd978276c could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:58:10.375976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9c775433-7132-4b05-8d9d-b7e5a6f38980 tempest-AttachVolumeShelveTestJSON-733385236 tempest-AttachVolumeShelveTestJSON-733385236-project] 10.222.0.103 "GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c" status: 404 len: 111 microversion: 2.1 time: 0.077005 Apr 16 16:58:10.376592 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 541/1068] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:10 2021] GET /compute/v2.1/servers/bf021fce-d230-4117-992c-f91cd978276c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:58:11.223230 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-16fafa6f-1753-46dd-889e-39f3f5b86467 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d44574f28>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:11.294802 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-16fafa6f-1753-46dd-889e-39f3f5b86467 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] HTTP exception thrown: Volume dd5c5524-99f6-4da7-882b-354b9b9807da could not be found. Apr 16 16:58:11.295619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-16fafa6f-1753-46dd-889e-39f3f5b86467 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Returning 404 to user: Volume dd5c5524-99f6-4da7-882b-354b9b9807da could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:58:11.296928 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-16fafa6f-1753-46dd-889e-39f3f5b86467 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da" status: 404 len: 109 microversion: 2.1 time: 0.077819 Apr 16 16:58:11.297732 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 528/1069] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:58:11 2021] GET /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:58:11.314808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0f2f23b6-bbc8-4ba9-a844-74991c2eb3d5 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d499ccd90>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:11.380880 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-0f2f23b6-bbc8-4ba9-a844-74991c2eb3d5 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] HTTP exception thrown: Volume dd5c5524-99f6-4da7-882b-354b9b9807da could not be found. Apr 16 16:58:11.381560 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0f2f23b6-bbc8-4ba9-a844-74991c2eb3d5 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Returning 404 to user: Volume dd5c5524-99f6-4da7-882b-354b9b9807da could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:58:11.382532 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0f2f23b6-bbc8-4ba9-a844-74991c2eb3d5 tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "DELETE /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da" status: 404 len: 109 microversion: 2.1 time: 0.072201 Apr 16 16:58:11.383137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 542/1070] 10.222.0.103 () {58 vars in 1243 bytes} [Fri Apr 16 16:58:11 2021] DELETE /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:58:11.392664 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-276c8b49-edac-4728-8fb4-8eb9779b272b tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Calling method '.version_select at 0x7f0d450f30d0>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:11.461729 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-276c8b49-edac-4728-8fb4-8eb9779b272b tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] HTTP exception thrown: Volume dd5c5524-99f6-4da7-882b-354b9b9807da could not be found. Apr 16 16:58:11.462427 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-276c8b49-edac-4728-8fb4-8eb9779b272b tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] Returning 404 to user: Volume dd5c5524-99f6-4da7-882b-354b9b9807da could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 16:58:11.463331 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-276c8b49-edac-4728-8fb4-8eb9779b272b tempest-VolumesSnapshotsTestJSON-711792573 tempest-VolumesSnapshotsTestJSON-711792573-project] 10.222.0.103 "GET /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da" status: 404 len: 109 microversion: 2.1 time: 0.075181 Apr 16 16:58:11.463923 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 529/1071] 10.222.0.103 () {58 vars in 1240 bytes} [Fri Apr 16 16:58:11 2021] GET /compute/v2.1/os-volumes/dd5c5524-99f6-4da7-882b-354b9b9807da => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 16:58:32.760840 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1175233805", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-680428694", "security_groups": [{"name": "tempest-secgroup-smoke-162326361"}], "block_device_mapping_v2": [{"uuid": "cedb2421-801e-4846-ac26-7c05774d60f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4fdfd20a-86ba-40ff-badd-033e171b120f"}]}} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:58:32.950625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] validate_networks() for [('4fdfd20a-86ba-40ff-badd-033e171b120f', None, None, None)] {{(pid=99398) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:58:33.889475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Flavor limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:58:33.889997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Image limits 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:58:33.890501 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Flavor pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:58:33.891010 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Image pref 0:0:0 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:58:33.891472 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99398) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:58:33.901159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:33.901667 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:33.903113 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:33.903620 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:33.923826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Getting quotas for project 215e50567539412caa22fd5000dc74a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:58:33.928244 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Getting quotas for user 33d512498d26488895520590b4b2ea1d and project 215e50567539412caa22fd5000dc74a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99398) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:58:34.047870 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Going to run 1 instances... {{(pid=99398) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:58:34.050403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cedb2421-801e-4846-ac26-7c05774d60f8',volume_size=None,volume_type=None)] {{(pid=99398) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:58:34.306065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-431d6170-8999-4168-afbd-4d3abaf03ee3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.549796 Apr 16 16:58:34.313654 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 543/1072] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:58:32 2021] POST /compute/v2.1/servers => generated 407 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:58:34.321538 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-824f1bda-eac8-4cbe-99a1-ccc491e33167 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:34.322805 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-824f1bda-eac8-4cbe-99a1-ccc491e33167 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:34.443941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-824f1bda-eac8-4cbe-99a1-ccc491e33167 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:34.454152 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-824f1bda-eac8-4cbe-99a1-ccc491e33167 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1097 microversion: 2.1 time: 0.138193 Apr 16 16:58:34.454796 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 530/1073] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:34 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1097 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:35.472607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7d47041b-21c0-4c9f-b714-0a2c16277db8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:35.474003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7d47041b-21c0-4c9f-b714-0a2c16277db8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:35.485681 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d47041b-21c0-4c9f-b714-0a2c16277db8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:35.486669 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d47041b-21c0-4c9f-b714-0a2c16277db8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:35.487761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d47041b-21c0-4c9f-b714-0a2c16277db8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:35.488455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d47041b-21c0-4c9f-b714-0a2c16277db8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:35.690047 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7d47041b-21c0-4c9f-b714-0a2c16277db8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:35.700065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7d47041b-21c0-4c9f-b714-0a2c16277db8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1203 microversion: 2.1 time: 0.230949 Apr 16 16:58:35.701011 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 544/1074] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:35 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1203 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:36.723383 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4e2f965c-5487-4aa9-8a4a-499d7d7561cc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:36.725393 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4e2f965c-5487-4aa9-8a4a-499d7d7561cc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:36.740726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4e2f965c-5487-4aa9-8a4a-499d7d7561cc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:36.741599 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4e2f965c-5487-4aa9-8a4a-499d7d7561cc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:36.742243 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4e2f965c-5487-4aa9-8a4a-499d7d7561cc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:36.742892 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4e2f965c-5487-4aa9-8a4a-499d7d7561cc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:36.998671 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4e2f965c-5487-4aa9-8a4a-499d7d7561cc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:37.017961 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4e2f965c-5487-4aa9-8a4a-499d7d7561cc tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1280 microversion: 2.1 time: 0.302185 Apr 16 16:58:37.030971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 531/1075] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:36 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1280 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:38.045215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0423cd7f-b0a1-4437-9854-4e0c41c3fda5 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:38.046005 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0423cd7f-b0a1-4437-9854-4e0c41c3fda5 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:38.059170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0423cd7f-b0a1-4437-9854-4e0c41c3fda5 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:38.060321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0423cd7f-b0a1-4437-9854-4e0c41c3fda5 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:38.061927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0423cd7f-b0a1-4437-9854-4e0c41c3fda5 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:38.062865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0423cd7f-b0a1-4437-9854-4e0c41c3fda5 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:38.374485 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0423cd7f-b0a1-4437-9854-4e0c41c3fda5 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:38.384556 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0423cd7f-b0a1-4437-9854-4e0c41c3fda5 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.344875 Apr 16 16:58:38.384967 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 545/1076] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:38 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:39.111614 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-fec665f2-a8fb-4fc9-ac98-79536da0f90f req-96bb7041-b1af-499a-b669-cce69eb4f1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b7503f-8c29-497f-8939-6e4617f535d3", "tag": "fcd782b2-f086-47ae-829a-ed1f6897d2d3"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:58:39.113768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:58:39.113768 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:58:39.130429 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-fec665f2-a8fb-4fc9-ac98-79536da0f90f req-96bb7041-b1af-499a-b669-cce69eb4f1ea service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:39.132111 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-fec665f2-a8fb-4fc9-ac98-79536da0f90f req-96bb7041-b1af-499a-b669-cce69eb4f1ea service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:39.154327 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-fec665f2-a8fb-4fc9-ac98-79536da0f90f req-96bb7041-b1af-499a-b669-cce69eb4f1ea service nova] Creating event network-changed:fcd782b2-f086-47ae-829a-ed1f6897d2d3 for instance 16b7503f-8c29-497f-8939-6e4617f535d3 on hv-cinder-73362 Apr 16 16:58:39.161185 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-fec665f2-a8fb-4fc9-ac98-79536da0f90f req-96bb7041-b1af-499a-b669-cce69eb4f1ea service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053825 Apr 16 16:58:39.161942 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 532/1077] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:58:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:39.406324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-64eac057-1e85-49e9-a6ef-e259ee288c4c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:39.407487 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-64eac057-1e85-49e9-a6ef-e259ee288c4c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:39.415994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-64eac057-1e85-49e9-a6ef-e259ee288c4c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:39.416506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-64eac057-1e85-49e9-a6ef-e259ee288c4c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:39.417524 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-64eac057-1e85-49e9-a6ef-e259ee288c4c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:39.418061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-64eac057-1e85-49e9-a6ef-e259ee288c4c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:39.656696 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-64eac057-1e85-49e9-a6ef-e259ee288c4c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:39.666719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-64eac057-1e85-49e9-a6ef-e259ee288c4c tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.265831 Apr 16 16:58:39.667355 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 546/1078] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:39 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:40.687334 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c0568cb0-e14c-4264-8fb8-674a5687288b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:40.688136 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c0568cb0-e14c-4264-8fb8-674a5687288b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:40.697082 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c0568cb0-e14c-4264-8fb8-674a5687288b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:40.698240 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c0568cb0-e14c-4264-8fb8-674a5687288b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:40.700048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c0568cb0-e14c-4264-8fb8-674a5687288b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:40.700769 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c0568cb0-e14c-4264-8fb8-674a5687288b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:40.949752 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-c0568cb0-e14c-4264-8fb8-674a5687288b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:40.958953 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c0568cb0-e14c-4264-8fb8-674a5687288b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.276731 Apr 16 16:58:40.959586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 533/1079] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:40 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:41.977468 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9b16f56b-d054-4e2e-b580-78020ffefe8d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:41.978139 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9b16f56b-d054-4e2e-b580-78020ffefe8d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:41.989969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b16f56b-d054-4e2e-b580-78020ffefe8d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:41.990925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b16f56b-d054-4e2e-b580-78020ffefe8d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:41.992427 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b16f56b-d054-4e2e-b580-78020ffefe8d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:41.993353 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9b16f56b-d054-4e2e-b580-78020ffefe8d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:42.315245 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9b16f56b-d054-4e2e-b580-78020ffefe8d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:42.325056 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9b16f56b-d054-4e2e-b580-78020ffefe8d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.351767 Apr 16 16:58:42.325717 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 547/1080] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:41 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:43.344250 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5c6f3f6a-d808-4f26-8a0d-fd03aadedcb0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:43.346504 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5c6f3f6a-d808-4f26-8a0d-fd03aadedcb0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:43.353364 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c6f3f6a-d808-4f26-8a0d-fd03aadedcb0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:43.353873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c6f3f6a-d808-4f26-8a0d-fd03aadedcb0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:43.354766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c6f3f6a-d808-4f26-8a0d-fd03aadedcb0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:43.355266 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5c6f3f6a-d808-4f26-8a0d-fd03aadedcb0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:43.588439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-5c6f3f6a-d808-4f26-8a0d-fd03aadedcb0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:43.597803 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5c6f3f6a-d808-4f26-8a0d-fd03aadedcb0 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.258689 Apr 16 16:58:43.598369 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 534/1081] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:43 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:44.617642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-58039ae3-c7ae-41ec-92af-70efa6b085e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:44.618329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-58039ae3-c7ae-41ec-92af-70efa6b085e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:44.628564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-58039ae3-c7ae-41ec-92af-70efa6b085e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:44.629090 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-58039ae3-c7ae-41ec-92af-70efa6b085e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:44.630048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-58039ae3-c7ae-41ec-92af-70efa6b085e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:44.630659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-58039ae3-c7ae-41ec-92af-70efa6b085e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:44.874438 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-58039ae3-c7ae-41ec-92af-70efa6b085e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:44.883863 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-58039ae3-c7ae-41ec-92af-70efa6b085e8 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.270157 Apr 16 16:58:44.884488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 548/1082] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:44 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:45.904441 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-60955bc8-e8d5-4428-a52e-f25394d6e825 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:45.905106 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-60955bc8-e8d5-4428-a52e-f25394d6e825 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:45.913303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60955bc8-e8d5-4428-a52e-f25394d6e825 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:45.913810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60955bc8-e8d5-4428-a52e-f25394d6e825 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:45.914708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60955bc8-e8d5-4428-a52e-f25394d6e825 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:45.915200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60955bc8-e8d5-4428-a52e-f25394d6e825 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:46.165000 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-60955bc8-e8d5-4428-a52e-f25394d6e825 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:46.175659 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-60955bc8-e8d5-4428-a52e-f25394d6e825 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.275387 Apr 16 16:58:46.176321 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 535/1083] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:45 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:47.197979 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4efeb50d-d978-408c-8680-9d6e7b25de5b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:47.198691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4efeb50d-d978-408c-8680-9d6e7b25de5b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:47.207191 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4efeb50d-d978-408c-8680-9d6e7b25de5b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:47.207693 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4efeb50d-d978-408c-8680-9d6e7b25de5b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:47.208539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4efeb50d-d978-408c-8680-9d6e7b25de5b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:47.209036 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4efeb50d-d978-408c-8680-9d6e7b25de5b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:47.441289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4efeb50d-d978-408c-8680-9d6e7b25de5b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:47.451697 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4efeb50d-d978-408c-8680-9d6e7b25de5b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.258788 Apr 16 16:58:47.452343 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 549/1084] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:47 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:48.472109 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-19c19baa-9d0f-4bbb-914b-fce7b6d36e77 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:48.472742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-19c19baa-9d0f-4bbb-914b-fce7b6d36e77 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:48.481774 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-19c19baa-9d0f-4bbb-914b-fce7b6d36e77 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:48.482304 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-19c19baa-9d0f-4bbb-914b-fce7b6d36e77 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:48.483171 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-19c19baa-9d0f-4bbb-914b-fce7b6d36e77 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:48.483666 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-19c19baa-9d0f-4bbb-914b-fce7b6d36e77 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:48.744488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-19c19baa-9d0f-4bbb-914b-fce7b6d36e77 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:48.756101 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-19c19baa-9d0f-4bbb-914b-fce7b6d36e77 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.287897 Apr 16 16:58:48.756808 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 536/1085] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:48 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:49.795349 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d598aa06-9d67-44b5-9b73-c6450924154d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:49.797019 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d598aa06-9d67-44b5-9b73-c6450924154d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:49.814761 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d598aa06-9d67-44b5-9b73-c6450924154d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:49.816202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d598aa06-9d67-44b5-9b73-c6450924154d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:49.818058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d598aa06-9d67-44b5-9b73-c6450924154d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:49.819286 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d598aa06-9d67-44b5-9b73-c6450924154d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:50.160488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-5e2b4c2c-1893-4dae-a779-20a621e7127e req-95256a64-3711-4d1a-8dbd-b25e22eed250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b7503f-8c29-497f-8939-6e4617f535d3", "name": "network-vif-plugged", "status": "completed", "tag": "fcd782b2-f086-47ae-829a-ed1f6897d2d3"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:58:50.160488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:58:50.160488 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:58:50.163511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-5e2b4c2c-1893-4dae-a779-20a621e7127e req-95256a64-3711-4d1a-8dbd-b25e22eed250 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:50.164247 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-5e2b4c2c-1893-4dae-a779-20a621e7127e req-95256a64-3711-4d1a-8dbd-b25e22eed250 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:50.172607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d598aa06-9d67-44b5-9b73-c6450924154d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:50.183957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-5e2b4c2c-1893-4dae-a779-20a621e7127e req-95256a64-3711-4d1a-8dbd-b25e22eed250 service nova] Creating event network-vif-plugged:fcd782b2-f086-47ae-829a-ed1f6897d2d3 for instance 16b7503f-8c29-497f-8939-6e4617f535d3 on hv-cinder-73362 Apr 16 16:58:50.190051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-5e2b4c2c-1893-4dae-a779-20a621e7127e req-95256a64-3711-4d1a-8dbd-b25e22eed250 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042771 Apr 16 16:58:50.190826 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d598aa06-9d67-44b5-9b73-c6450924154d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.417821 Apr 16 16:58:50.191064 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 537/1086] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:58:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:58:50.191789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 550/1087] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:49 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:51.221347 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7387775a-3d02-42ab-9177-8687a648cdc3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:51.223457 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7387775a-3d02-42ab-9177-8687a648cdc3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:51.233918 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7387775a-3d02-42ab-9177-8687a648cdc3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:51.234497 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7387775a-3d02-42ab-9177-8687a648cdc3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:51.235422 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7387775a-3d02-42ab-9177-8687a648cdc3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:51.235994 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7387775a-3d02-42ab-9177-8687a648cdc3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:51.550930 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7387775a-3d02-42ab-9177-8687a648cdc3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:51.561985 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7387775a-3d02-42ab-9177-8687a648cdc3 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1268 microversion: 2.1 time: 0.347833 Apr 16 16:58:51.562810 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 538/1088] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:51 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1268 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:52.586945 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e2f89134-23b2-46cf-bee4-9e5370c2308d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:52.589075 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e2f89134-23b2-46cf-bee4-9e5370c2308d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:52.607135 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2f89134-23b2-46cf-bee4-9e5370c2308d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:52.608140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2f89134-23b2-46cf-bee4-9e5370c2308d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:52.609726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2f89134-23b2-46cf-bee4-9e5370c2308d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:52.610719 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2f89134-23b2-46cf-bee4-9e5370c2308d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:52.905134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e2f89134-23b2-46cf-bee4-9e5370c2308d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:52.914417 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e2f89134-23b2-46cf-bee4-9e5370c2308d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1455 microversion: 2.1 time: 0.336744 Apr 16 16:58:52.914962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 551/1089] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:52 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1455 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:52.933726 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3c7b7475-caa6-4dde-8e9e-5ca238fe503a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:58:52.934813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3c7b7475-caa6-4dde-8e9e-5ca238fe503a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:58:52.946653 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c7b7475-caa6-4dde-8e9e-5ca238fe503a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:52.947437 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c7b7475-caa6-4dde-8e9e-5ca238fe503a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:52.948277 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c7b7475-caa6-4dde-8e9e-5ca238fe503a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:52.949077 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c7b7475-caa6-4dde-8e9e-5ca238fe503a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:53.282935 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3c7b7475-caa6-4dde-8e9e-5ca238fe503a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:58:53.293281 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3c7b7475-caa6-4dde-8e9e-5ca238fe503a tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1455 microversion: 2.1 time: 0.363468 Apr 16 16:58:53.294381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 539/1090] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:58:52 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1455 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:58:57.122309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-fae4e630-dbb4-4e81-baa0-488b8fa4c4ed req-860750ff-4226-4aec-9c3d-8d1608071224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b7503f-8c29-497f-8939-6e4617f535d3", "tag": "fcd782b2-f086-47ae-829a-ed1f6897d2d3"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:58:57.124115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:58:57.124115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:58:57.134142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-fae4e630-dbb4-4e81-baa0-488b8fa4c4ed req-860750ff-4226-4aec-9c3d-8d1608071224 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:58:57.134689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-fae4e630-dbb4-4e81-baa0-488b8fa4c4ed req-860750ff-4226-4aec-9c3d-8d1608071224 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:58:57.153881 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-fae4e630-dbb4-4e81-baa0-488b8fa4c4ed req-860750ff-4226-4aec-9c3d-8d1608071224 service nova] Creating event network-changed:fcd782b2-f086-47ae-829a-ed1f6897d2d3 for instance 16b7503f-8c29-497f-8939-6e4617f535d3 on hv-cinder-73362 Apr 16 16:58:57.159320 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-fae4e630-dbb4-4e81-baa0-488b8fa4c4ed req-860750ff-4226-4aec-9c3d-8d1608071224 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042143 Apr 16 16:58:57.160027 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 552/1091] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:58:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:59:13.590071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-548120287", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "networks": [{"uuid": "49cdb1bd-d813-4c42-949f-122ca1e716f8"}]}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:59:13.663190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] validate_networks() for [('49cdb1bd-d813-4c42-949f-122ca1e716f8', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 16:59:14.198397 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 16:59:14.198927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 16:59:14.199464 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 16:59:14.199914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 16:59:14.200420 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 16:59:14.209621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:14.210144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:14.211025 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:14.211512 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:14.232009 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Getting quotas for project a61003aa4cff4b38b07ec68a01d15c6b. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 16:59:14.236402 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Getting quotas for user fa18b408687f4cf1980dd5456373d3a0 and project a61003aa4cff4b38b07ec68a01d15c6b. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 16:59:14.248421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 16:59:14.251335 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 16:59:14.302801 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [ff4f08fe-edea-4f0f-9291-e808618e8d58] AMQP server on 10.222.0.103:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 16:59:15.319806 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [ff4f08fe-edea-4f0f-9291-e808618e8d58] Reconnected to AMQP server on 10.222.0.103:5672 via [amqp] client with port 34252. Apr 16 16:59:15.325766 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-542733c6-65e7-425e-a643-98250f9e200b tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.740103 Apr 16 16:59:15.326664 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 540/1092] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 16:59:13 2021] POST /compute/v2.1/servers => generated 382 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 16:59:15.339903 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d3965980-6507-4779-8dd8-3e1870bcb4fe tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:59:15.340820 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d3965980-6507-4779-8dd8-3e1870bcb4fe tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:59:15.445892 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d3965980-6507-4779-8dd8-3e1870bcb4fe tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:59:15.456509 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d3965980-6507-4779-8dd8-3e1870bcb4fe tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1222 microversion: 2.1 time: 0.121829 Apr 16 16:59:15.457186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 553/1093] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:59:15 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:59:16.477279 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-4484f061-81c7-4cd0-9b3a-42d5e6a11d48 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:59:16.478193 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-4484f061-81c7-4cd0-9b3a-42d5e6a11d48 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:59:16.493401 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4484f061-81c7-4cd0-9b3a-42d5e6a11d48 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:16.493914 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4484f061-81c7-4cd0-9b3a-42d5e6a11d48 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:16.495240 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4484f061-81c7-4cd0-9b3a-42d5e6a11d48 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:16.496507 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-4484f061-81c7-4cd0-9b3a-42d5e6a11d48 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:16.679186 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-4484f061-81c7-4cd0-9b3a-42d5e6a11d48 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:59:16.689981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-4484f061-81c7-4cd0-9b3a-42d5e6a11d48 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1282 microversion: 2.1 time: 0.217267 Apr 16 16:59:16.690888 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 541/1094] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:59:16 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1282 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:59:17.713271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2244b133-f95e-4bde-b7f1-d0515efcaad9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:59:17.714530 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2244b133-f95e-4bde-b7f1-d0515efcaad9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:59:17.724135 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2244b133-f95e-4bde-b7f1-d0515efcaad9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:17.725172 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2244b133-f95e-4bde-b7f1-d0515efcaad9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:17.726132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2244b133-f95e-4bde-b7f1-d0515efcaad9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:17.726708 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2244b133-f95e-4bde-b7f1-d0515efcaad9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:17.954639 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2244b133-f95e-4bde-b7f1-d0515efcaad9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:59:17.964156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2244b133-f95e-4bde-b7f1-d0515efcaad9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1322 microversion: 2.1 time: 0.254501 Apr 16 16:59:17.964816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 554/1095] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:59:17 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:59:18.987594 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0507f011-8945-4430-a2d5-3692d947c1af tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:59:18.989559 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0507f011-8945-4430-a2d5-3692d947c1af tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:59:19.004348 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0507f011-8945-4430-a2d5-3692d947c1af tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:19.005451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0507f011-8945-4430-a2d5-3692d947c1af tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:19.006381 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0507f011-8945-4430-a2d5-3692d947c1af tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:19.007219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0507f011-8945-4430-a2d5-3692d947c1af tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:19.396202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0507f011-8945-4430-a2d5-3692d947c1af tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:59:19.410001 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0507f011-8945-4430-a2d5-3692d947c1af tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1322 microversion: 2.1 time: 0.430427 Apr 16 16:59:19.411042 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 542/1096] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:59:18 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:59:19.544226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-47dac698-997b-42c0-8e35-ba3ae7783e25 req-d95ef7c3-85f5-434d-bec4-ac9bf57f041b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3", "tag": "b911bd21-3512-4c95-9737-fa92e1bc2c69"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:59:19.545976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:59:19.545976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:59:19.554898 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-47dac698-997b-42c0-8e35-ba3ae7783e25 req-d95ef7c3-85f5-434d-bec4-ac9bf57f041b service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:19.555405 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-47dac698-997b-42c0-8e35-ba3ae7783e25 req-d95ef7c3-85f5-434d-bec4-ac9bf57f041b service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:19.574308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-47dac698-997b-42c0-8e35-ba3ae7783e25 req-d95ef7c3-85f5-434d-bec4-ac9bf57f041b service nova] Creating event network-changed:b911bd21-3512-4c95-9737-fa92e1bc2c69 for instance 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 on hv-cinder-73362 Apr 16 16:59:19.579686 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-47dac698-997b-42c0-8e35-ba3ae7783e25 req-d95ef7c3-85f5-434d-bec4-ac9bf57f041b service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041245 Apr 16 16:59:19.580326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 555/1097] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:59:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:59:20.430293 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-3c0de41c-250c-4c5d-9e43-ac89d262a1a0 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:59:20.431576 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-3c0de41c-250c-4c5d-9e43-ac89d262a1a0 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:59:20.439902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c0de41c-250c-4c5d-9e43-ac89d262a1a0 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:20.440699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c0de41c-250c-4c5d-9e43-ac89d262a1a0 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:20.441537 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c0de41c-250c-4c5d-9e43-ac89d262a1a0 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:20.442024 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-3c0de41c-250c-4c5d-9e43-ac89d262a1a0 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:20.689716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-3c0de41c-250c-4c5d-9e43-ac89d262a1a0 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:59:20.699535 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-3c0de41c-250c-4c5d-9e43-ac89d262a1a0 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1322 microversion: 2.1 time: 0.273793 Apr 16 16:59:20.700610 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 543/1098] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:59:20 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:59:21.719848 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a4f95131-7b1e-4feb-a6ba-b17a0e16144d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:59:21.720695 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a4f95131-7b1e-4feb-a6ba-b17a0e16144d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:59:21.729048 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4f95131-7b1e-4feb-a6ba-b17a0e16144d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:21.730388 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4f95131-7b1e-4feb-a6ba-b17a0e16144d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:21.731446 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4f95131-7b1e-4feb-a6ba-b17a0e16144d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:21.731944 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4f95131-7b1e-4feb-a6ba-b17a0e16144d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:22.220539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a4f95131-7b1e-4feb-a6ba-b17a0e16144d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:59:22.232167 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a4f95131-7b1e-4feb-a6ba-b17a0e16144d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1322 microversion: 2.1 time: 0.517374 Apr 16 16:59:22.233190 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 556/1099] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:59:21 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1322 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:59:23.251482 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-00b78e29-b835-4460-82c0-541bffdb6639 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:59:23.252309 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-00b78e29-b835-4460-82c0-541bffdb6639 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:59:23.260500 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-00b78e29-b835-4460-82c0-541bffdb6639 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:23.261026 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-00b78e29-b835-4460-82c0-541bffdb6639 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:23.261873 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-00b78e29-b835-4460-82c0-541bffdb6639 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:23.262438 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-00b78e29-b835-4460-82c0-541bffdb6639 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:23.490361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-00b78e29-b835-4460-82c0-541bffdb6639 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:59:23.499832 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-00b78e29-b835-4460-82c0-541bffdb6639 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1322 microversion: 2.1 time: 0.252603 Apr 16 16:59:23.500534 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 544/1100] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:59:23 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:59:24.095600 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-39850043-588f-4d09-9f4e-ce4a8db57174 req-0613d883-9b0a-44bd-902f-c7b34682c0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3", "name": "network-vif-plugged", "status": "completed", "tag": "b911bd21-3512-4c95-9737-fa92e1bc2c69"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:59:24.097580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 16:59:24.097580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 16:59:24.106550 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-39850043-588f-4d09-9f4e-ce4a8db57174 req-0613d883-9b0a-44bd-902f-c7b34682c0f9 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:24.107063 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-39850043-588f-4d09-9f4e-ce4a8db57174 req-0613d883-9b0a-44bd-902f-c7b34682c0f9 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:24.125508 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-39850043-588f-4d09-9f4e-ce4a8db57174 req-0613d883-9b0a-44bd-902f-c7b34682c0f9 service nova] Creating event network-vif-plugged:b911bd21-3512-4c95-9737-fa92e1bc2c69 for instance 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 on hv-cinder-73362 Apr 16 16:59:24.130790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-39850043-588f-4d09-9f4e-ce4a8db57174 req-0613d883-9b0a-44bd-902f-c7b34682c0f9 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039126 Apr 16 16:59:24.131608 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 557/1101] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 16:59:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 16:59:24.517992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d7c4a594-62af-4d9c-9943-d6f3afc82f02 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:59:24.518685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d7c4a594-62af-4d9c-9943-d6f3afc82f02 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:59:24.527479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d7c4a594-62af-4d9c-9943-d6f3afc82f02 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:24.527991 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d7c4a594-62af-4d9c-9943-d6f3afc82f02 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:24.528833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d7c4a594-62af-4d9c-9943-d6f3afc82f02 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:24.529329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d7c4a594-62af-4d9c-9943-d6f3afc82f02 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:24.760297 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-d7c4a594-62af-4d9c-9943-d6f3afc82f02 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:59:24.770112 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d7c4a594-62af-4d9c-9943-d6f3afc82f02 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1322 microversion: 2.1 time: 0.255866 Apr 16 16:59:24.770767 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 545/1102] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:59:24 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:59:25.789996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-2e272073-d54e-44b1-b1cf-2088e014e914 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 16:59:25.790717 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-2e272073-d54e-44b1-b1cf-2088e014e914 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:59:25.799439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e272073-d54e-44b1-b1cf-2088e014e914 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:25.799946 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e272073-d54e-44b1-b1cf-2088e014e914 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:25.800778 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e272073-d54e-44b1-b1cf-2088e014e914 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:25.801259 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-2e272073-d54e-44b1-b1cf-2088e014e914 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:26.025453 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-2e272073-d54e-44b1-b1cf-2088e014e914 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 16:59:26.034902 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-2e272073-d54e-44b1-b1cf-2088e014e914 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1512 microversion: 2.1 time: 0.249548 Apr 16 16:59:26.035330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 558/1103] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 16:59:25 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 16:59:44.477073 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a4ada7a2-c053-4fa0-8443-04e42032b205 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7aeb888-df24-49cd-9023-344b40fc29e7", "device": "/dev/sdb"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 16:59:44.480458 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a4ada7a2-c053-4fa0-8443-04e42032b205 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 16:59:44.494603 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4ada7a2-c053-4fa0-8443-04e42032b205 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:44.495731 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4ada7a2-c053-4fa0-8443-04e42032b205 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:44.497078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4ada7a2-c053-4fa0-8443-04e42032b205 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 16:59:44.497964 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a4ada7a2-c053-4fa0-8443-04e42032b205 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 16:59:45.190734 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a4ada7a2-c053-4fa0-8443-04e42032b205 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "POST /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719584 Apr 16 16:59:45.191434 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 546/1104] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 16:59:44 2021] POST /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 17:00:09.129062 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-da7d0bed-d728-4c0d-ba97-bc6f7bab1598 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:09.129611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-da7d0bed-d728-4c0d-ba97-bc6f7bab1598 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:09.137846 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da7d0bed-d728-4c0d-ba97-bc6f7bab1598 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:09.138392 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da7d0bed-d728-4c0d-ba97-bc6f7bab1598 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:09.139229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da7d0bed-d728-4c0d-ba97-bc6f7bab1598 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:09.139718 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-da7d0bed-d728-4c0d-ba97-bc6f7bab1598 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:09.381571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-da7d0bed-d728-4c0d-ba97-bc6f7bab1598 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lazy-loading 'services' on Instance uuid 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 17:00:09.532273 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-da7d0bed-d728-4c0d-ba97-bc6f7bab1598 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "DELETE /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3/os-volume_attachments/e7aeb888-df24-49cd-9023-344b40fc29e7" status: 202 len: 0 microversion: 2.1 time: 0.406863 Apr 16 17:00:09.532927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 559/1105] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 17:00:09 2021] DELETE /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3/os-volume_attachments/e7aeb888-df24-49cd-9023-344b40fc29e7 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 17:00:10.756931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5a7c5453-3202-40fc-93a1-ae6f44302cc1 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:10.757565 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5a7c5453-3202-40fc-93a1-ae6f44302cc1 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:10.767699 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a7c5453-3202-40fc-93a1-ae6f44302cc1 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:10.768336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a7c5453-3202-40fc-93a1-ae6f44302cc1 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:10.769516 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a7c5453-3202-40fc-93a1-ae6f44302cc1 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:10.770041 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5a7c5453-3202-40fc-93a1-ae6f44302cc1 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:10.839716 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5a7c5453-3202-40fc-93a1-ae6f44302cc1 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Going to try to terminate instance {{(pid=99399) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 17:00:10.964455 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5a7c5453-3202-40fc-93a1-ae6f44302cc1 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "DELETE /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 204 len: 0 microversion: 2.1 time: 0.211611 Apr 16 17:00:10.965103 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 547/1106] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 17:00:10 2021] DELETE /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 17:00:10.975573 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-807932b1-de08-4a49-98cc-73f700194734 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:10.976338 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-807932b1-de08-4a49-98cc-73f700194734 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:10.985607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-807932b1-de08-4a49-98cc-73f700194734 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:10.986110 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-807932b1-de08-4a49-98cc-73f700194734 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:10.986980 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-807932b1-de08-4a49-98cc-73f700194734 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:10.987471 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-807932b1-de08-4a49-98cc-73f700194734 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:11.210764 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-807932b1-de08-4a49-98cc-73f700194734 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:11.220525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-807932b1-de08-4a49-98cc-73f700194734 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1518 microversion: 2.1 time: 0.250355 Apr 16 17:00:11.221122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 560/1107] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:10 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1518 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:12.240411 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0c743cf0-5348-4d47-b1ea-16ef6f71b86e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:12.241209 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0c743cf0-5348-4d47-b1ea-16ef6f71b86e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:12.249111 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c743cf0-5348-4d47-b1ea-16ef6f71b86e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:12.249619 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c743cf0-5348-4d47-b1ea-16ef6f71b86e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:12.250490 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c743cf0-5348-4d47-b1ea-16ef6f71b86e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:12.250989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0c743cf0-5348-4d47-b1ea-16ef6f71b86e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:12.469200 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-0c743cf0-5348-4d47-b1ea-16ef6f71b86e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:12.478609 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0c743cf0-5348-4d47-b1ea-16ef6f71b86e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1518 microversion: 2.1 time: 0.242716 Apr 16 17:00:12.479415 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 548/1108] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:12 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1518 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:13.501411 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-03acab1a-a2ee-468c-bbff-371269d28f0f tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:13.502140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-03acab1a-a2ee-468c-bbff-371269d28f0f tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:13.511061 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03acab1a-a2ee-468c-bbff-371269d28f0f tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:13.511577 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03acab1a-a2ee-468c-bbff-371269d28f0f tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:13.512435 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03acab1a-a2ee-468c-bbff-371269d28f0f tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:13.512957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-03acab1a-a2ee-468c-bbff-371269d28f0f tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:13.674058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-03acab1a-a2ee-468c-bbff-371269d28f0f tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:13.683865 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-03acab1a-a2ee-468c-bbff-371269d28f0f tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 200 len: 1476 microversion: 2.1 time: 0.190882 Apr 16 17:00:13.684491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 561/1109] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:13 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 1476 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:13.887226 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-64f971b6-9aa0-4e69-afd8-7c19ed04693f req-faa92953-fcfa-43a4-a532-2935bb5b7233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3", "name": "network-vif-deleted", "tag": "b911bd21-3512-4c95-9737-fa92e1bc2c69"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 17:00:13.889289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 17:00:13.889289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 17:00:13.899336 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-64f971b6-9aa0-4e69-afd8-7c19ed04693f req-faa92953-fcfa-43a4-a532-2935bb5b7233 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:13.899838 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-64f971b6-9aa0-4e69-afd8-7c19ed04693f req-faa92953-fcfa-43a4-a532-2935bb5b7233 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:13.918937 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-64f971b6-9aa0-4e69-afd8-7c19ed04693f req-faa92953-fcfa-43a4-a532-2935bb5b7233 service nova] Creating event network-vif-deleted:b911bd21-3512-4c95-9737-fa92e1bc2c69 for instance 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 on hv-cinder-73362 Apr 16 17:00:13.924480 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-64f971b6-9aa0-4e69-afd8-7c19ed04693f req-faa92953-fcfa-43a4-a532-2935bb5b7233 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041995 Apr 16 17:00:13.925215 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 549/1110] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 17:00:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 17:00:14.231900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 17:00:14.232156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 17:00:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 17:00:14.702486 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5729eb4c-b92a-4e89-9279-46bac26a580a tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:14.703197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-5729eb4c-b92a-4e89-9279-46bac26a580a tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:14.711018 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5729eb4c-b92a-4e89-9279-46bac26a580a tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:14.711529 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5729eb4c-b92a-4e89-9279-46bac26a580a tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:14.712365 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5729eb4c-b92a-4e89-9279-46bac26a580a tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:14.712850 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-5729eb4c-b92a-4e89-9279-46bac26a580a tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:14.768788 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-5729eb4c-b92a-4e89-9279-46bac26a580a tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] HTTP exception thrown: Instance 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 could not be found. Apr 16 17:00:14.769701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-5729eb4c-b92a-4e89-9279-46bac26a580a tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Returning 404 to user: Instance 4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 17:00:14.770632 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-5729eb4c-b92a-4e89-9279-46bac26a580a tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3" status: 404 len: 111 microversion: 2.1 time: 0.072431 Apr 16 17:00:14.771240 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 562/1111] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:14 2021] GET /compute/v2.1/servers/4f6cc0a3-6de5-40dd-bfba-4ee3a929fec3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 17:00:25.243168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2008408743", "imageRef": "1be4b5bb-1446-459e-9ea4-7befb93a1464", "flavorRef": "452", "networks": [{"uuid": "49cdb1bd-d813-4c42-949f-122ca1e716f8"}]}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 17:00:25.325192 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.network.neutron [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] validate_networks() for [('49cdb1bd-d813-4c42-949f-122ca1e716f8', None, None, None)] {{(pid=99399) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 16 17:00:26.087148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Flavor limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 17:00:26.088500 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Image limits 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 16 17:00:26.089484 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Flavor pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 17:00:26.090361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Image pref 0:0:0 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 16 17:00:26.091129 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.virt.hardware [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=99399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 16 17:00:26.103593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:26.104615 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:26.105648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:26.106134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:26.130959 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Getting quotas for project a61003aa4cff4b38b07ec68a01d15c6b. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 16 17:00:26.136142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.quota [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Getting quotas for user fa18b408687f4cf1980dd5456373d3a0 and project a61003aa4cff4b38b07ec68a01d15c6b. Resources: {'cores', 'instances', 'ram'} {{(pid=99399) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 16 17:00:26.152285 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Going to run 1 instances... {{(pid=99399) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 16 17:00:26.155198 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1be4b5bb-1446-459e-9ea4-7befb93a1464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 16 17:00:26.218028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8b276d63-1eab-4317-a2e8-bc44f0b58eb4 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.979971 Apr 16 17:00:26.219157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 550/1112] 10.222.0.103 () {60 vars in 1142 bytes} [Fri Apr 16 17:00:25 2021] POST /compute/v2.1/servers => generated 382 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 17:00:26.231981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8bbc6270-845d-454a-a456-8c1d6e809504 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:26.232663 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-8bbc6270-845d-454a-a456-8c1d6e809504 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:26.324354 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-8bbc6270-845d-454a-a456-8c1d6e809504 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:26.332963 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8bbc6270-845d-454a-a456-8c1d6e809504 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1223 microversion: 2.1 time: 0.106703 Apr 16 17:00:26.334598 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 563/1113] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:26 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:27.352457 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7d3799a5-460e-40b1-982f-d6b6518568d6 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:27.353140 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7d3799a5-460e-40b1-982f-d6b6518568d6 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:27.362361 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d3799a5-460e-40b1-982f-d6b6518568d6 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:27.362843 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d3799a5-460e-40b1-982f-d6b6518568d6 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:27.363684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d3799a5-460e-40b1-982f-d6b6518568d6 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:27.364317 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7d3799a5-460e-40b1-982f-d6b6518568d6 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:27.511735 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7d3799a5-460e-40b1-982f-d6b6518568d6 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:27.522403 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7d3799a5-460e-40b1-982f-d6b6518568d6 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1275 microversion: 2.1 time: 0.174280 Apr 16 17:00:27.523384 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 551/1114] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:27 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1275 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:27.624107 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-dc3d0475-7de1-4071-a407-14e9dbe4e609 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:27.624921 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dc3d0475-7de1-4071-a407-14e9dbe4e609 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:27.627165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-a21a4ca4-b59d-4942-8c14-eb26492bd7d7 req-880a8cf4-901d-40b0-b158-342cd119a61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b7503f-8c29-497f-8939-6e4617f535d3", "tag": "fcd782b2-f086-47ae-829a-ed1f6897d2d3"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 17:00:27.629270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 17:00:27.629270 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 17:00:27.634470 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc3d0475-7de1-4071-a407-14e9dbe4e609 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:27.635115 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc3d0475-7de1-4071-a407-14e9dbe4e609 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:27.636032 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc3d0475-7de1-4071-a407-14e9dbe4e609 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:27.636530 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-dc3d0475-7de1-4071-a407-14e9dbe4e609 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:27.640525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-a21a4ca4-b59d-4942-8c14-eb26492bd7d7 req-880a8cf4-901d-40b0-b158-342cd119a61c service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:27.641146 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-a21a4ca4-b59d-4942-8c14-eb26492bd7d7 req-880a8cf4-901d-40b0-b158-342cd119a61c service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:27.664132 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-a21a4ca4-b59d-4942-8c14-eb26492bd7d7 req-880a8cf4-901d-40b0-b158-342cd119a61c service nova] Creating event network-changed:fcd782b2-f086-47ae-829a-ed1f6897d2d3 for instance 16b7503f-8c29-497f-8939-6e4617f535d3 on hv-cinder-73362 Apr 16 17:00:27.672003 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-a21a4ca4-b59d-4942-8c14-eb26492bd7d7 req-880a8cf4-901d-40b0-b158-342cd119a61c service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049267 Apr 16 17:00:27.673267 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 552/1115] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 17:00:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 17:00:27.713982 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-dc3d0475-7de1-4071-a407-14e9dbe4e609 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 17:00:27.889574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-dc3d0475-7de1-4071-a407-14e9dbe4e609 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "DELETE /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 204 len: 0 microversion: 2.1 time: 0.270857 Apr 16 17:00:27.894220 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 564/1116] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 17:00:27 2021] DELETE /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 17:00:27.903900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e25d0385-e23d-4565-bec7-e3d63b7bfc08 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:27.905324 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e25d0385-e23d-4565-bec7-e3d63b7bfc08 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:27.929237 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e25d0385-e23d-4565-bec7-e3d63b7bfc08 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:27.930925 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e25d0385-e23d-4565-bec7-e3d63b7bfc08 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:27.935571 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e25d0385-e23d-4565-bec7-e3d63b7bfc08 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:27.937673 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e25d0385-e23d-4565-bec7-e3d63b7bfc08 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:28.440587 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e25d0385-e23d-4565-bec7-e3d63b7bfc08 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:28.452642 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e25d0385-e23d-4565-bec7-e3d63b7bfc08 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1579 microversion: 2.1 time: 0.555769 Apr 16 17:00:28.453541 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 553/1117] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:27 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1579 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:28.543329 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e2da09f5-116d-411c-8bfd-fdc23193ba2d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:28.544378 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e2da09f5-116d-411c-8bfd-fdc23193ba2d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:28.553883 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2da09f5-116d-411c-8bfd-fdc23193ba2d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:28.554656 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2da09f5-116d-411c-8bfd-fdc23193ba2d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:28.555668 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2da09f5-116d-411c-8bfd-fdc23193ba2d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:28.556328 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e2da09f5-116d-411c-8bfd-fdc23193ba2d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:29.064203 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e2da09f5-116d-411c-8bfd-fdc23193ba2d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:29.084424 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e2da09f5-116d-411c-8bfd-fdc23193ba2d tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1323 microversion: 2.1 time: 0.545291 Apr 16 17:00:29.086058 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 565/1118] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:28 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1323 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:29.473511 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6ba7a5e5-a2e0-4c38-99f9-cf9c45f8645b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:29.474219 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6ba7a5e5-a2e0-4c38-99f9-cf9c45f8645b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:29.483092 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ba7a5e5-a2e0-4c38-99f9-cf9c45f8645b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:29.483601 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ba7a5e5-a2e0-4c38-99f9-cf9c45f8645b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:29.484491 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ba7a5e5-a2e0-4c38-99f9-cf9c45f8645b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:29.485177 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6ba7a5e5-a2e0-4c38-99f9-cf9c45f8645b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:29.917524 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-6ba7a5e5-a2e0-4c38-99f9-cf9c45f8645b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:29.927510 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6ba7a5e5-a2e0-4c38-99f9-cf9c45f8645b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1461 microversion: 2.1 time: 0.457968 Apr 16 17:00:29.936741 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 554/1119] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:29 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1461 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:30.107648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-895fbc4b-9f97-44fb-9468-dfcb8b5e7094 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:30.108252 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-895fbc4b-9f97-44fb-9468-dfcb8b5e7094 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:30.117222 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-895fbc4b-9f97-44fb-9468-dfcb8b5e7094 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:30.117772 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-895fbc4b-9f97-44fb-9468-dfcb8b5e7094 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:30.118703 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-895fbc4b-9f97-44fb-9468-dfcb8b5e7094 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:30.119728 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-895fbc4b-9f97-44fb-9468-dfcb8b5e7094 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:30.576589 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-895fbc4b-9f97-44fb-9468-dfcb8b5e7094 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:30.586137 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-895fbc4b-9f97-44fb-9468-dfcb8b5e7094 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1323 microversion: 2.1 time: 0.483617 Apr 16 17:00:30.587158 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 566/1120] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:30 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1323 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 17:00:30.860253 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-c284a95f-f306-4856-9107-738e6bf55aee req-33c35b34-6b15-45e7-90e0-e3d2f2e06616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6617a0ac-3870-47db-bce3-1ce8b8499fce", "tag": "bbdc1ddf-a456-4a02-a2f4-315c8e6fa784"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 17:00:30.862079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 17:00:30.862079 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 17:00:30.875189 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-c284a95f-f306-4856-9107-738e6bf55aee req-33c35b34-6b15-45e7-90e0-e3d2f2e06616 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:30.875740 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-c284a95f-f306-4856-9107-738e6bf55aee req-33c35b34-6b15-45e7-90e0-e3d2f2e06616 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:30.896586 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-c284a95f-f306-4856-9107-738e6bf55aee req-33c35b34-6b15-45e7-90e0-e3d2f2e06616 service nova] Creating event network-changed:bbdc1ddf-a456-4a02-a2f4-315c8e6fa784 for instance 6617a0ac-3870-47db-bce3-1ce8b8499fce on hv-cinder-73362 Apr 16 17:00:30.903977 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-c284a95f-f306-4856-9107-738e6bf55aee req-33c35b34-6b15-45e7-90e0-e3d2f2e06616 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047617 Apr 16 17:00:30.905607 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 555/1121] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 17:00:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 17:00:30.950777 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-89648722-5504-437a-a97f-229c94962d31 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:30.951927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-89648722-5504-437a-a97f-229c94962d31 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:30.956985 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-721018d3-9ab1-4ddf-9be3-b90ca5c28798 req-0859eed5-b0ec-4a36-b385-babc9c34f644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b7503f-8c29-497f-8939-6e4617f535d3", "name": "network-vif-deleted", "tag": "fcd782b2-f086-47ae-829a-ed1f6897d2d3"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 17:00:30.959031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 17:00:30.959031 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 17:00:30.961316 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89648722-5504-437a-a97f-229c94962d31 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:30.961937 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89648722-5504-437a-a97f-229c94962d31 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:30.962996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89648722-5504-437a-a97f-229c94962d31 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:30.963755 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-89648722-5504-437a-a97f-229c94962d31 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:30.969527 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-721018d3-9ab1-4ddf-9be3-b90ca5c28798 req-0859eed5-b0ec-4a36-b385-babc9c34f644 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:30.970519 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-721018d3-9ab1-4ddf-9be3-b90ca5c28798 req-0859eed5-b0ec-4a36-b385-babc9c34f644 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:30.991645 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-721018d3-9ab1-4ddf-9be3-b90ca5c28798 req-0859eed5-b0ec-4a36-b385-babc9c34f644 service nova] Creating event network-vif-deleted:fcd782b2-f086-47ae-829a-ed1f6897d2d3 for instance 16b7503f-8c29-497f-8939-6e4617f535d3 on hv-cinder-73362 Apr 16 17:00:30.998459 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-721018d3-9ab1-4ddf-9be3-b90ca5c28798 req-0859eed5-b0ec-4a36-b385-babc9c34f644 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118623 Apr 16 17:00:30.999346 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 567/1122] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 17:00:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 17:00:31.128015 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-89648722-5504-437a-a97f-229c94962d31 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:31.137453 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-89648722-5504-437a-a97f-229c94962d31 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 200 len: 1228 microversion: 2.1 time: 0.192699 Apr 16 17:00:31.138477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 556/1123] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:30 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 1228 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:31.606330 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a0e666de-f7a4-4a29-9d97-893eb0684e12 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:31.607163 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a0e666de-f7a4-4a29-9d97-893eb0684e12 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:31.617178 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a0e666de-f7a4-4a29-9d97-893eb0684e12 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:31.617611 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a0e666de-f7a4-4a29-9d97-893eb0684e12 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:31.618506 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a0e666de-f7a4-4a29-9d97-893eb0684e12 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:31.619416 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a0e666de-f7a4-4a29-9d97-893eb0684e12 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:31.864165 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-a0e666de-f7a4-4a29-9d97-893eb0684e12 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:31.874834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a0e666de-f7a4-4a29-9d97-893eb0684e12 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1323 microversion: 2.1 time: 0.273293 Apr 16 17:00:31.875420 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 568/1124] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:31 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:32.156790 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0bb8eb6a-9b0f-4153-b300-c15b8dccda6b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:32.157376 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-0bb8eb6a-9b0f-4153-b300-c15b8dccda6b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 16b7503f-8c29-497f-8939-6e4617f535d3] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:32.165221 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0bb8eb6a-9b0f-4153-b300-c15b8dccda6b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:32.165724 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0bb8eb6a-9b0f-4153-b300-c15b8dccda6b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:32.166849 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0bb8eb6a-9b0f-4153-b300-c15b8dccda6b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:32.167454 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-0bb8eb6a-9b0f-4153-b300-c15b8dccda6b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:32.224319 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-0bb8eb6a-9b0f-4153-b300-c15b8dccda6b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] HTTP exception thrown: Instance 16b7503f-8c29-497f-8939-6e4617f535d3 could not be found. Apr 16 17:00:32.224988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-0bb8eb6a-9b0f-4153-b300-c15b8dccda6b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Returning 404 to user: Instance 16b7503f-8c29-497f-8939-6e4617f535d3 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 17:00:32.225900 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-0bb8eb6a-9b0f-4153-b300-c15b8dccda6b tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3" status: 404 len: 111 microversion: 2.1 time: 0.073305 Apr 16 17:00:32.226597 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 557/1125] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:32 2021] GET /compute/v2.1/servers/16b7503f-8c29-497f-8939-6e4617f535d3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 17:00:32.894909 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-44d0b617-73e4-4d59-a2c5-9551980f2c82 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:32.895604 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-44d0b617-73e4-4d59-a2c5-9551980f2c82 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:32.904028 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-44d0b617-73e4-4d59-a2c5-9551980f2c82 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:32.904537 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-44d0b617-73e4-4d59-a2c5-9551980f2c82 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:32.905372 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-44d0b617-73e4-4d59-a2c5-9551980f2c82 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:32.905864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-44d0b617-73e4-4d59-a2c5-9551980f2c82 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:33.129988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-44d0b617-73e4-4d59-a2c5-9551980f2c82 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:33.139996 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-44d0b617-73e4-4d59-a2c5-9551980f2c82 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1323 microversion: 2.1 time: 0.249366 Apr 16 17:00:33.140631 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 569/1126] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:32 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:34.159420 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-9669bf90-9824-4d04-b1a8-c6f553657d87 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:34.160088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-9669bf90-9824-4d04-b1a8-c6f553657d87 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:34.168630 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9669bf90-9824-4d04-b1a8-c6f553657d87 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:34.169133 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9669bf90-9824-4d04-b1a8-c6f553657d87 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:34.169971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9669bf90-9824-4d04-b1a8-c6f553657d87 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:34.170489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-9669bf90-9824-4d04-b1a8-c6f553657d87 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:34.547400 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-9669bf90-9824-4d04-b1a8-c6f553657d87 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:34.558595 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-9669bf90-9824-4d04-b1a8-c6f553657d87 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1323 microversion: 2.1 time: 0.403316 Apr 16 17:00:34.559241 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 558/1127] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:34 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:35.578834 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fa989066-8728-492f-aea5-6791b511ed4e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:35.579494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fa989066-8728-492f-aea5-6791b511ed4e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:35.589081 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa989066-8728-492f-aea5-6791b511ed4e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:35.589590 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa989066-8728-492f-aea5-6791b511ed4e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:35.590522 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa989066-8728-492f-aea5-6791b511ed4e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:35.592156 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fa989066-8728-492f-aea5-6791b511ed4e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:35.832475 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fa989066-8728-492f-aea5-6791b511ed4e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:35.843539 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fa989066-8728-492f-aea5-6791b511ed4e tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1323 microversion: 2.1 time: 0.269866 Apr 16 17:00:35.855687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 570/1128] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:35 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1323 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:36.571382 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-8836a858-bc7d-4b37-82b0-49a11595013c req-d5324b12-b26f-4331-974b-999d739a35c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6617a0ac-3870-47db-bce3-1ce8b8499fce", "name": "network-vif-plugged", "status": "completed", "tag": "bbdc1ddf-a456-4a02-a2f4-315c8e6fa784"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 17:00:36.573997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 17:00:36.573997 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 17:00:36.583971 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-8836a858-bc7d-4b37-82b0-49a11595013c req-d5324b12-b26f-4331-974b-999d739a35c8 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:36.584520 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-8836a858-bc7d-4b37-82b0-49a11595013c req-d5324b12-b26f-4331-974b-999d739a35c8 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:36.602969 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-8836a858-bc7d-4b37-82b0-49a11595013c req-d5324b12-b26f-4331-974b-999d739a35c8 service nova] Creating event network-vif-plugged:bbdc1ddf-a456-4a02-a2f4-315c8e6fa784 for instance 6617a0ac-3870-47db-bce3-1ce8b8499fce on hv-cinder-73362 Apr 16 17:00:36.608580 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-8836a858-bc7d-4b37-82b0-49a11595013c req-d5324b12-b26f-4331-974b-999d739a35c8 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043879 Apr 16 17:00:36.609422 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 559/1129] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 17:00:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 17:00:36.657756 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-d5cee6c1-440c-40d9-975f-ea122ce5c3bd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:36.658322 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d5cee6c1-440c-40d9-975f-ea122ce5c3bd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:36.662008 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-b78754ee-94ef-41a6-ba46-c6d45a93bf79 req-b6990227-1eff-446e-bbe6-e2c9a6618359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ed33ad-b824-4144-a51d-81ba74e24a4b", "tag": "2139fff4-2645-4ee4-90d3-2b1dcf4f8a76"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 17:00:36.663999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 17:00:36.663999 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 17:00:36.666326 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5cee6c1-440c-40d9-975f-ea122ce5c3bd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:36.667126 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5cee6c1-440c-40d9-975f-ea122ce5c3bd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:36.668134 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5cee6c1-440c-40d9-975f-ea122ce5c3bd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:36.668773 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-d5cee6c1-440c-40d9-975f-ea122ce5c3bd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:36.674225 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-b78754ee-94ef-41a6-ba46-c6d45a93bf79 req-b6990227-1eff-446e-bbe6-e2c9a6618359 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:36.674749 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-b78754ee-94ef-41a6-ba46-c6d45a93bf79 req-b6990227-1eff-446e-bbe6-e2c9a6618359 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:36.695523 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-b78754ee-94ef-41a6-ba46-c6d45a93bf79 req-b6990227-1eff-446e-bbe6-e2c9a6618359 service nova] Creating event network-changed:2139fff4-2645-4ee4-90d3-2b1dcf4f8a76 for instance a3ed33ad-b824-4144-a51d-81ba74e24a4b on hv-cinder-73362 Apr 16 17:00:36.702046 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-b78754ee-94ef-41a6-ba46-c6d45a93bf79 req-b6990227-1eff-446e-bbe6-e2c9a6618359 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044726 Apr 16 17:00:36.702759 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 560/1130] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 17:00:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 17:00:36.741648 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-d5cee6c1-440c-40d9-975f-ea122ce5c3bd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Going to try to terminate instance {{(pid=99398) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 17:00:36.863088 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-fdf3be40-94af-4d1e-a13f-4abb20bf6817 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:36.864569 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-fdf3be40-94af-4d1e-a13f-4abb20bf6817 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:36.879691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdf3be40-94af-4d1e-a13f-4abb20bf6817 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:36.880202 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdf3be40-94af-4d1e-a13f-4abb20bf6817 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:36.881059 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdf3be40-94af-4d1e-a13f-4abb20bf6817 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:36.881552 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-fdf3be40-94af-4d1e-a13f-4abb20bf6817 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:36.926229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-d5cee6c1-440c-40d9-975f-ea122ce5c3bd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "DELETE /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 204 len: 0 microversion: 2.1 time: 0.272152 Apr 16 17:00:36.926910 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 571/1131] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 17:00:36 2021] DELETE /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 17:00:36.938622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-427af70f-d3a3-4736-8875-37fe67498bb9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:36.939451 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-427af70f-d3a3-4736-8875-37fe67498bb9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:36.950023 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-427af70f-d3a3-4736-8875-37fe67498bb9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:36.950303 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-427af70f-d3a3-4736-8875-37fe67498bb9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:36.950981 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-427af70f-d3a3-4736-8875-37fe67498bb9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:36.951479 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-427af70f-d3a3-4736-8875-37fe67498bb9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:37.766020 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-fdf3be40-94af-4d1e-a13f-4abb20bf6817 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:37.778692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-fdf3be40-94af-4d1e-a13f-4abb20bf6817 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1323 microversion: 2.1 time: 0.920646 Apr 16 17:00:37.786736 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 561/1132] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:36 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1323 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:37.793012 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-427af70f-d3a3-4736-8875-37fe67498bb9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:37.802229 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-427af70f-d3a3-4736-8875-37fe67498bb9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1581 microversion: 2.1 time: 0.869443 Apr 16 17:00:37.803100 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 572/1133] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:36 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1581 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:38.802426 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-f71131b2-7d21-4d24-aba6-1c9d7cc79e78 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:38.803645 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-f71131b2-7d21-4d24-aba6-1c9d7cc79e78 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:38.814733 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f71131b2-7d21-4d24-aba6-1c9d7cc79e78 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:38.815299 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f71131b2-7d21-4d24-aba6-1c9d7cc79e78 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:38.816294 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f71131b2-7d21-4d24-aba6-1c9d7cc79e78 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:38.818350 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-f71131b2-7d21-4d24-aba6-1c9d7cc79e78 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:38.826081 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-60420c6b-0b91-4cdc-90b8-1d45dad07f0d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:38.827094 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-60420c6b-0b91-4cdc-90b8-1d45dad07f0d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:38.840051 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60420c6b-0b91-4cdc-90b8-1d45dad07f0d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:38.840814 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60420c6b-0b91-4cdc-90b8-1d45dad07f0d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:38.841879 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60420c6b-0b91-4cdc-90b8-1d45dad07f0d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:38.842564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-60420c6b-0b91-4cdc-90b8-1d45dad07f0d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:39.169594 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-f71131b2-7d21-4d24-aba6-1c9d7cc79e78 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:39.183821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-f71131b2-7d21-4d24-aba6-1c9d7cc79e78 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1513 microversion: 2.1 time: 0.387517 Apr 16 17:00:39.184684 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-60420c6b-0b91-4cdc-90b8-1d45dad07f0d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:39.185271 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 562/1134] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:38 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1513 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:39.195765 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-60420c6b-0b91-4cdc-90b8-1d45dad07f0d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1462 microversion: 2.1 time: 0.376004 Apr 16 17:00:39.196398 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 573/1135] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:38 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1462 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:39.206833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-410a8b4c-2420-46ae-8df6-a60b07af05c5 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f54e496-0048-447c-a66f-b3d8c84b93f7", "device": "/dev/sdb"}} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 17:00:39.206833 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-410a8b4c-2420-46ae-8df6-a60b07af05c5 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:39.214685 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-410a8b4c-2420-46ae-8df6-a60b07af05c5 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:39.215287 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-410a8b4c-2420-46ae-8df6-a60b07af05c5 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:39.216159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-410a8b4c-2420-46ae-8df6-a60b07af05c5 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:39.216652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-410a8b4c-2420-46ae-8df6-a60b07af05c5 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:39.716473 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-410a8b4c-2420-46ae-8df6-a60b07af05c5 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "POST /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.516469 Apr 16 17:00:39.717157 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 563/1136] 10.222.0.103 () {60 vars in 1318 bytes} [Fri Apr 16 17:00:39 2021] POST /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce/os-volume_attachments => generated 194 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 17:00:39.818035 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-6bb64882-65ba-4e60-9f18-3500ad95c610 req-a48b7a52-34c1-4e52-b6e5-5df4d856da6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ed33ad-b824-4144-a51d-81ba74e24a4b", "name": "network-vif-deleted", "tag": "2139fff4-2645-4ee4-90d3-2b1dcf4f8a76"}]} {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 17:00:39.822931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 17:00:39.822931 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 17:00:39.836864 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-6bb64882-65ba-4e60-9f18-3500ad95c610 req-a48b7a52-34c1-4e52-b6e5-5df4d856da6d service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:39.837905 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-6bb64882-65ba-4e60-9f18-3500ad95c610 req-a48b7a52-34c1-4e52-b6e5-5df4d856da6d service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:39.862962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-6bb64882-65ba-4e60-9f18-3500ad95c610 req-a48b7a52-34c1-4e52-b6e5-5df4d856da6d service nova] Creating event network-vif-deleted:2139fff4-2645-4ee4-90d3-2b1dcf4f8a76 for instance a3ed33ad-b824-4144-a51d-81ba74e24a4b on hv-cinder-73362 Apr 16 17:00:39.868652 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-6bb64882-65ba-4e60-9f18-3500ad95c610 req-a48b7a52-34c1-4e52-b6e5-5df4d856da6d service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055581 Apr 16 17:00:39.870276 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 574/1137] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 17:00:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 17:00:40.216811 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:40.217701 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:40.226976 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:40.227489 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:40.228394 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:40.229053 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:40.345199 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:40.345957 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:40.346828 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lazy-loading 'fault' on Instance uuid a3ed33ad-b824-4144-a51d-81ba74e24a4b {{(pid=99399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 17:00:40.426391 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d512498d26488895520590b4b2ea1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '215e50567539412caa22fd5000dc74a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:00:40.443452 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-17cf7cf9-9080-4c1b-a790-1e301864d4ae tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 200 len: 1233 microversion: 2.1 time: 0.232043 Apr 16 17:00:40.444525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 564/1138] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:40 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 1233 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:00:41.465023 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-067b7186-6acf-4b95-959e-a7f22fc9f833 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:41.465795 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-067b7186-6acf-4b95-959e-a7f22fc9f833 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: a3ed33ad-b824-4144-a51d-81ba74e24a4b] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:41.474687 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-067b7186-6acf-4b95-959e-a7f22fc9f833 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:41.475664 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-067b7186-6acf-4b95-959e-a7f22fc9f833 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:41.477168 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-067b7186-6acf-4b95-959e-a7f22fc9f833 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:41.477800 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-067b7186-6acf-4b95-959e-a7f22fc9f833 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:41.562922 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-067b7186-6acf-4b95-959e-a7f22fc9f833 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] HTTP exception thrown: Instance a3ed33ad-b824-4144-a51d-81ba74e24a4b could not be found. Apr 16 17:00:41.563989 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-067b7186-6acf-4b95-959e-a7f22fc9f833 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Returning 404 to user: Instance a3ed33ad-b824-4144-a51d-81ba74e24a4b could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 17:00:41.565568 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-067b7186-6acf-4b95-959e-a7f22fc9f833 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b" status: 404 len: 111 microversion: 2.1 time: 0.106015 Apr 16 17:00:41.566647 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 575/1139] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:41 2021] GET /compute/v2.1/servers/a3ed33ad-b824-4144-a51d-81ba74e24a4b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 17:00:42.645742 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a30e0ae2-fbf2-418e-a734-7ef8b93264b9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:42.646383 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-a30e0ae2-fbf2-418e-a734-7ef8b93264b9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:42.655796 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a30e0ae2-fbf2-418e-a734-7ef8b93264b9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:42.656308 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a30e0ae2-fbf2-418e-a734-7ef8b93264b9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:42.657232 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a30e0ae2-fbf2-418e-a734-7ef8b93264b9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:42.657691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-a30e0ae2-fbf2-418e-a734-7ef8b93264b9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:42.714221 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-a30e0ae2-fbf2-418e-a734-7ef8b93264b9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] HTTP exception thrown: Instance 954b9698-4e4c-4bd2-9cba-021819421e40 could not be found. Apr 16 17:00:42.714927 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-a30e0ae2-fbf2-418e-a734-7ef8b93264b9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Returning 404 to user: Instance 954b9698-4e4c-4bd2-9cba-021819421e40 could not be found. {{(pid=99399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 17:00:42.715847 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-a30e0ae2-fbf2-418e-a734-7ef8b93264b9 tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "DELETE /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 404 len: 111 microversion: 2.1 time: 0.074728 Apr 16 17:00:42.716469 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 565/1140] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 17:00:42 2021] DELETE /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 17:00:42.729525 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6fa15b42-7cd3-489b-af97-1121e9d6719d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:42.730212 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-6fa15b42-7cd3-489b-af97-1121e9d6719d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] [instance: 954b9698-4e4c-4bd2-9cba-021819421e40] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:42.738622 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6fa15b42-7cd3-489b-af97-1121e9d6719d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:42.739130 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6fa15b42-7cd3-489b-af97-1121e9d6719d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:42.739993 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6fa15b42-7cd3-489b-af97-1121e9d6719d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:42.740496 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-6fa15b42-7cd3-489b-af97-1121e9d6719d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:42.798372 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-6fa15b42-7cd3-489b-af97-1121e9d6719d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] HTTP exception thrown: Instance 954b9698-4e4c-4bd2-9cba-021819421e40 could not be found. Apr 16 17:00:42.799144 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-6fa15b42-7cd3-489b-af97-1121e9d6719d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Returning 404 to user: Instance 954b9698-4e4c-4bd2-9cba-021819421e40 could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 17:00:42.800126 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-6fa15b42-7cd3-489b-af97-1121e9d6719d tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40" status: 404 len: 111 microversion: 2.1 time: 0.078202 Apr 16 17:00:42.800916 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 576/1141] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:00:42 2021] GET /compute/v2.1/servers/954b9698-4e4c-4bd2-9cba-021819421e40 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 17:00:44.290617 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-8d2150c0-68ba-4b1a-a052-33c63c8f39bd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] Calling method '.version_select at 0x7f0d446e6620>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:44.313142 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-8d2150c0-68ba-4b1a-a052-33c63c8f39bd tempest-TestVolumeBootPattern-653432903 tempest-TestVolumeBootPattern-653432903-project] 10.222.0.103 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-680428694" status: 202 len: 0 microversion: 2.1 time: 0.027504 Apr 16 17:00:44.313779 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 566/1142] 10.222.0.103 () {58 vars in 1255 bytes} [Fri Apr 16 17:00:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-680428694 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 17:00:59.260988 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-10d2385e-2fa0-4db2-a99e-d9a5e1d23d5c tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:00:59.261564 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-10d2385e-2fa0-4db2-a99e-d9a5e1d23d5c tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:00:59.270421 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10d2385e-2fa0-4db2-a99e-d9a5e1d23d5c tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:59.270941 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10d2385e-2fa0-4db2-a99e-d9a5e1d23d5c tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:59.271789 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10d2385e-2fa0-4db2-a99e-d9a5e1d23d5c tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:00:59.272256 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-10d2385e-2fa0-4db2-a99e-d9a5e1d23d5c tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:00:59.475917 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.objects.instance [None req-10d2385e-2fa0-4db2-a99e-d9a5e1d23d5c tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lazy-loading 'services' on Instance uuid 6617a0ac-3870-47db-bce3-1ce8b8499fce {{(pid=99398) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 16 17:00:59.635680 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-10d2385e-2fa0-4db2-a99e-d9a5e1d23d5c tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "DELETE /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce/os-volume_attachments/5f54e496-0048-447c-a66f-b3d8c84b93f7" status: 202 len: 0 microversion: 2.1 time: 0.378946 Apr 16 17:00:59.637572 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 577/1143] 10.222.0.103 () {58 vars in 1411 bytes} [Fri Apr 16 17:00:59 2021] DELETE /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce/os-volume_attachments/5f54e496-0048-447c-a66f-b3d8c84b93f7 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 17:01:00.857159 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-caca904c-9f06-45b3-acf7-67551080fdb7 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:01:00.857704 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-caca904c-9f06-45b3-acf7-67551080fdb7 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:01:00.865962 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caca904c-9f06-45b3-acf7-67551080fdb7 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:00.866494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caca904c-9f06-45b3-acf7-67551080fdb7 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:00.867339 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caca904c-9f06-45b3-acf7-67551080fdb7 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:00.867821 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-caca904c-9f06-45b3-acf7-67551080fdb7 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:00.938625 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-caca904c-9f06-45b3-acf7-67551080fdb7 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Going to try to terminate instance {{(pid=99399) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 16 17:01:01.065233 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-caca904c-9f06-45b3-acf7-67551080fdb7 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "DELETE /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 204 len: 0 microversion: 2.1 time: 0.212470 Apr 16 17:01:01.066574 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 567/1144] 10.222.0.103 () {58 vars in 1234 bytes} [Fri Apr 16 17:01:00 2021] DELETE /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 17:01:01.078566 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-7e1bf3d7-eafa-4f93-ad7f-09b93e11f6d9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:01:01.079373 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-7e1bf3d7-eafa-4f93-ad7f-09b93e11f6d9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:01:01.087689 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e1bf3d7-eafa-4f93-ad7f-09b93e11f6d9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:01.088289 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e1bf3d7-eafa-4f93-ad7f-09b93e11f6d9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:01.089148 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e1bf3d7-eafa-4f93-ad7f-09b93e11f6d9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:01.089646 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-7e1bf3d7-eafa-4f93-ad7f-09b93e11f6d9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:01.331272 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-7e1bf3d7-eafa-4f93-ad7f-09b93e11f6d9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:01:01.342523 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-7e1bf3d7-eafa-4f93-ad7f-09b93e11f6d9 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1519 microversion: 2.1 time: 0.269450 Apr 16 17:01:01.343224 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 578/1145] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:01:01 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1519 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:01:02.363422 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-002744d6-5fe2-4ade-8b34-6111abdf7fac tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:01:02.364517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-002744d6-5fe2-4ade-8b34-6111abdf7fac tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99399) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:01:02.372683 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-002744d6-5fe2-4ade-8b34-6111abdf7fac tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:02.373170 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-002744d6-5fe2-4ade-8b34-6111abdf7fac tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:02.374060 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-002744d6-5fe2-4ade-8b34-6111abdf7fac tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:02.374585 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-002744d6-5fe2-4ade-8b34-6111abdf7fac tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:02.601657 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-002744d6-5fe2-4ade-8b34-6111abdf7fac tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99399) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:01:02.611439 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-002744d6-5fe2-4ade-8b34-6111abdf7fac tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1519 microversion: 2.1 time: 0.253021 Apr 16 17:01:02.612078 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 568/1146] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:01:02 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:01:03.631816 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-e24feb3b-7f05-49f5-bc2d-a0ada6db3692 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:01:03.632477 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-e24feb3b-7f05-49f5-bc2d-a0ada6db3692 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:01:03.641294 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e24feb3b-7f05-49f5-bc2d-a0ada6db3692 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:03.641796 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e24feb3b-7f05-49f5-bc2d-a0ada6db3692 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:03.642682 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e24feb3b-7f05-49f5-bc2d-a0ada6db3692 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:03.643430 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-e24feb3b-7f05-49f5-bc2d-a0ada6db3692 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:03.759040 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [req-18a0609a-4f07-4042-9eb5-599ae9db5aa2 req-074edd01-1029-47bb-846a-842ad3d10a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6617a0ac-3870-47db-bce3-1ce8b8499fce", "name": "network-vif-deleted", "tag": "bbdc1ddf-a456-4a02-a2f4-315c8e6fa784"}]} {{(pid=99399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 17:01:03.760965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 17:01:03.760965 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: warnings.warn(msg) Apr 16 17:01:03.772021 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-18a0609a-4f07-4042-9eb5-599ae9db5aa2 req-074edd01-1029-47bb-846a-842ad3d10a53 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:03.772515 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.policy [None req-e24feb3b-7f05-49f5-bc2d-a0ada6db3692 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa18b408687f4cf1980dd5456373d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61003aa4cff4b38b07ec68a01d15c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99398) authorize /opt/stack/nova/nova/policy.py:202}} Apr 16 17:01:03.772692 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [req-18a0609a-4f07-4042-9eb5-599ae9db5aa2 req-074edd01-1029-47bb-846a-842ad3d10a53 service nova] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99399) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:03.782639 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-e24feb3b-7f05-49f5-bc2d-a0ada6db3692 tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 200 len: 1477 microversion: 2.1 time: 0.154906 Apr 16 17:01:03.783380 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 579/1147] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:01:03 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 17:01:03.802129 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.compute.server_external_events [req-18a0609a-4f07-4042-9eb5-599ae9db5aa2 req-074edd01-1029-47bb-846a-842ad3d10a53 service nova] Creating event network-vif-deleted:bbdc1ddf-a456-4a02-a2f4-315c8e6fa784 for instance 6617a0ac-3870-47db-bce3-1ce8b8499fce on hv-cinder-73362 Apr 16 17:01:03.807890 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [req-18a0609a-4f07-4042-9eb5-599ae9db5aa2 req-074edd01-1029-47bb-846a-842ad3d10a53 service nova] 10.222.0.103 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052891 Apr 16 17:01:03.808621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99399|app: 0|req: 569/1148] 10.222.0.103 () {64 vars in 1313 bytes} [Fri Apr 16 17:01:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 17:01:04.801493 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c2b72c43-4e61-4e23-b986-244a7b486efa tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Calling method '>' {{(pid=99398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 16 17:01:04.802162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.compute.api [None req-c2b72c43-4e61-4e23-b986-244a7b486efa tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] [instance: 6617a0ac-3870-47db-bce3-1ce8b8499fce] Fetching instance by UUID {{(pid=99398) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 16 17:01:04.810784 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2b72c43-4e61-4e23-b986-244a7b486efa tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:04.811292 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2b72c43-4e61-4e23-b986-244a7b486efa tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:04.812129 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2b72c43-4e61-4e23-b986-244a7b486efa tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 16 17:01:04.812621 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG oslo_concurrency.lockutils [None req-c2b72c43-4e61-4e23-b986-244a7b486efa tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Lock "d7f43760-3e0c-42c8-aa11-8572e255d551" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99398) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 16 17:01:04.867030 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.wsgi [None req-c2b72c43-4e61-4e23-b986-244a7b486efa tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] HTTP exception thrown: Instance 6617a0ac-3870-47db-bce3-1ce8b8499fce could not be found. Apr 16 17:01:04.867691 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: DEBUG nova.api.openstack.wsgi [None req-c2b72c43-4e61-4e23-b986-244a7b486efa tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] Returning 404 to user: Instance 6617a0ac-3870-47db-bce3-1ce8b8499fce could not be found. {{(pid=99398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 16 17:01:04.869359 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO nova.api.openstack.requestlog [None req-c2b72c43-4e61-4e23-b986-244a7b486efa tempest-VolumesSnapshotTestJSON-406915743 tempest-VolumesSnapshotTestJSON-406915743-project] 10.222.0.103 "GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce" status: 404 len: 111 microversion: 2.1 time: 0.071246 Apr 16 17:01:04.870007 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: [pid: 99398|app: 0|req: 580/1149] 10.222.0.103 () {58 vars in 1231 bytes} [Fri Apr 16 17:01:04 2021] GET /compute/v2.1/servers/6617a0ac-3870-47db-bce3-1ce8b8499fce => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 17:01:49.239442 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 17:01:49.240071 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 17:01:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 17:03:12.210298 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 17:03:12.210813 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 17:03:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 17:03:19.788542 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 17:03:19.789147 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 17:03:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 17:03:34.249517 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 17:03:34.250122 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 17:03:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 17:03:53.835593 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 17:03:53.836197 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 17:03:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 17:05:09.257162 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 17:05:09.257713 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 17:05:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 17:06:19.774065 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 17:06:19.774605 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 17:06:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 17:06:32.228164 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 17:06:32.228640 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 17:06:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 17:06:39.805494 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 17:06:39.805992 dv-cinder-733622-13-iscsi devstack@n-api.service[99396]: Fri Apr 16 17:06:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!